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ABSTRACT 


Title of Thesis: Partially Ordered Spaces and Newton’s 

Method for Convex Operators 
James S. Vandergraft^ Doctor of Philosophy, 1966 
Thesis directed by; Werner C. Rheinboldt, Research Professor 

Some general theorems are proved concerning Newton's 
method applied to convex operators which are defined on 
partially ordered topological linear spaces. The spaces 
are examined and various relations between the partial 
ordering and the topology are discussed. A mean value 
theorem is proved and is then used to study convex operators . 
Several convergence theorems for Newton's method are 
obtained and applications to differential and integral 
equations are given. Finally, these results are used to 
simplify a theorem of Kantorovich concerning the converg- 
ence of Newton ' s method applied to operators which are 
defined on spaces with partially ordered norm. 
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INTRODUCTION 


If F is a nonlinear operator from one topological 
linear space to another, then Newton's method consists of 
finding the sequence defined by 

(1) X =x - (F* [x ] )“^F[x ] 

n+1 n n n 


where F* [x ] is either the Frechet or Gateaux derivative of 
n 

F at x^. The first general theorem concerning the converg- 
ence of this method was given by Kantorovich in 1948 [13] . 
Under a ntunber of assumptions on F, and the starting point 
Xq/ he proved that the sequence exists and converges to a 
solution of the equation F [x] = 0. The conditions on F 
and Xq, which are needed for the proof, involve bounds on 
F" [x] and on the inverse of F ' [x], . Because of the complex- 
ity of these conditions, it is often impossible to apply the 
result to practical problems. Moreover, the restrictions 
on Xq may limit it to a very small region, as is already 
shown by real functions. In a later paper [14], Kantorovich 
re-proved his basic theorem, using a completely different 
method of proof. He also generalized this proof to operators 
defined on spaces which have a partially ordered norm. In 
this generalized theorem, however, the assumption is made 
that, for a certain auxiliary operator, Newton's method 
produces a sequence which is monotone, bounded, and conver- 


gent. 

It is well-known that for many operators, the sequence 
defined by (i) is monotone and bounded. In this case, the 
proof of ' convergence may be simplified considerably. Such 
special theorems have been given by Collatz [7] , Kalaba 
[11] , and Greenspan and Barter [10] . All of these results 
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use some sort of convexity assumption on the operator in 
order to get the monotonicity of the iterates. 

In the present work/ we have proven some' very general 
convergence theorems for Newton's method applied to convex 
operators. These theorems contain the results of Collatz, 
Kalaba, and Greenspan and Parter cited above. The operators 
we consider are defined on certain classes of topological 
linear spaces in which a partial ordering is defined. 

Chapter I is devoted to a study of such spaces and of the 
operators defined on them. After a review of some basic 
notions about partially ordered spaces, we define partially 
ordered topological linear spaces (PTL spaces) , and discuss 
some important relations between the ordering and the topol- 
ogy. The treatment here is similar to Krasnoselski ' s theory 
of partially ordered Banach spaces [18] , however, we assume 
that the spaces are only locally convex. In the section on 
operators in PTL spaces, a mean value theorem is proved and 
is subsequently used to study convex operators. 

Chapter II is then devoted to Newton ' s metho_d_- We 
first prove a general convergence theorem for convex 
operators defined on a class of spaces which includes the 
finite dimensional spaces and the L^ spaces . The results 
we prove differ from those of Kantorovich in several ways. 
For example, we assume that F ' [x^] is only a Gateaux 
derivative, whereas, in Kantorovich's theorem, F' [x^] is 
the Frechet derivative. Also, we write (1) in the weaker 
form 


F' [x ] (x , ^ - X ) = -F[x ] 
n n+1 n n 


and prove that •[ j exists and converges, without proving 

that F' [x ] has an inverse. In fact, an example is given 
n 

to show that under our conditions, F ' [x^] need not have an 



inverse. Several examples are analyzed to show how the 
theorem can he applied, and some numerical calculations 
are given. The rate of convergence is shown to he quad- 
ratic, or super-linear, provided the derivative of the 
operator satisfies certain boundedness conditions. Finally, 
we discuss some possible modifications of Newton's method 
which still lead to monotone and convergent iterations. We 
also note the works of Baluev [1,2,3] and Slugin[24,25] , 
These papers, which are concerned with Chaplygin methods, 
contain results that are quite similar to some of ours . 
However, in all cases where a comparison can he made, it 
is clear that our results are stronger. 

In the next section, we consider a class of spaces 
which includes the spaces of differentiable functions. 
Because of convergence problems here, we restrict ourselves 
to operators of the form 

F [x J = f (x) -> L [x] 

where L is a linear operator and f is a convex operator. 

The theorems for these operators are of the same type as 
those of the previous section. Various differential 
equations are studied, and it is shown that the results of 
Kalaba in [11] are covered by these theorems. 

The last section contains a modification of the 
second Kantorovich theorem mentioned earlier. Using the 
previous results, we can actually prove that the auxiliary 
operator has a Newton sequence which is monotone, bounded, 
and convergent. Hence, the Kantorovich result is simplified 
considerably, and we obtain an interesting convergence 
theorem for general (i.e., -not necessarily convex) operators 



CHAPTER I 


PARTIAL ORDERINGS 
P artially Ordered Linear S paces 

The basis for all our discussions will be partially 
ordered linear spaces. Many of the following results can 
be found in Birlchoff [6] , Namioka [20] , or Schaefer [21] , 
but we include them here for the sake of completeness. 

Definition 1 . Let X be a real linear space in which 
a binary relation £ is defined between certain elements 
such that; 

1) X i x’ for all X in X 

2) if X £: y and y x then x = y 

3 ) if X £: y and y ^ z then x 6 z 

4) if X* y then x+z 4 . y+z for any z in X 

5) if X ^ y then ax,^ ay for any positive a. 

Then X is called a partially ordered linear space , ( PL space) . 

Conditions 1) ,2) ,3) say the ordering is reflexive, 
anti- symmetric, and transitive. The last two properties 
provide a connection between the order structure and the 
linear structure of the space. 

If a and b are elements in a PL space, and a^b, 
then the closed interval [a,b] is the set {x ; a^x^;b} . 

If S is any subset of X, then an element u in X is called 
an upper bound on S if x^u for all x in S. Similarly, 

^ lower bound on S is any v in X such that v 4 x for all 
X in S, An element u in X is called a supremum of S if, 

u is an upper bound and, moreover, if v is another upper 

bound on S, then u^v. Similarly, an infimum of S is a 
lower bound v, such that v^u where u is any other lower 

bound. It is clear from condition 2) of the definition 

that a set can have at most one infimum and supremum. 
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A subset is called order-bounded if it has both an upper 
bound and a lower bound. 

In a PL space, the set K = ^x:x?'0| has the properties: 

1) K + Kc:k, 

2) aKCK for any positive a, 

3) kH (-K) = {o} 

These follow easily from definition 1. A subset of a 
linear space which satisfies 1) and 2) is called a (convex) 
cone , and if 3) is also fulfilled, the cone is called 
proper . The set K defined above is called the positive 
cone for the PL, space . 

It is important to observe the duality between proper 
cones and partial orderings. We have just seen that the 
order relation in a PL space defines a proper cone. Conversely, 
if we are given a proper cone K in a linear space X, then 
the order relation defined by 

X i y if and only if y-x e K 

satisfies all the conditions of definition 1, and hence 
makes X into a PL space. Thus we can completely define 
a PL space by giving the space X and the positive cone K. 

For this reason, we will write (X,K) for a PL space X with 
positive cone K. 

2 

Two examples of PL spaces are (E ,K ) , where 

2 ^ 

K^- {(x,y) : x^O and y?> o} , and (E /K^)/ where 

K = [(x,y) : X = 0 and y o] . That is, in the first 

space, (x,y) ^ (u,v) means x^: u and y4 v, whereas, in the 

second space, (x,y) ^ (u,v) means x = u and y^ v. An 

important difference between these spaces is that in the 

2 

ordering defined by K^, any two points in E have a supremum 
and an infimum, whereas, with the other ordering, the points 
(0,1) and (1,1) do not have a common upper or lower bound, 
and hence no supremum or infimum. PL spaces in which 
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every pair of elements have an infimum and a supremum 

are called vector lattices. Hence, (E^,K. ) is a vector 

2 ^ 

lattice while {E ,K ) is not. If, however, we have a 
2 ^ 

set S in (E which is order hounded, then that set 

has an infimum and a supremum, since all members of S 
must have the same x-coordinate . A PL space in which every 
order bounded non-empty subset has a supremum and an 
infimum is said to be complete' . If every countable order- 
bounded set has a supremum and an infimum, the space is 
called q~ -ccanplete . 

Some basic relations which hold in a vector lattice 
are given in the following theorem. (The proof can be 
found in [6], p.219) . 

Theorem 1 In a vector lattice X, the following 
relations hold for any x,y,z in X. 

a) sup (x , y) +z=sup ,(x+z , y+z ) 

b) x+y=sup(x,y) + inf(x,y) 

c) asup(x,y) = sup (ax, ay), for a>0 

d) asup(x,y) = inf (ax, ay), for a<0 

e) sup (inf (x,y) ,z) = inf (sup (x,z) ,sup (y,z) ) . 

Moreover, all of these relations remain valid if sup and 
inf are everywhere interchanged. 

If the space is <r -complete, then these relations 

can be extended to bounded countable sets. That is, if 

^ x^ ^ is bounded , 

a ‘ ) sup (x^) + z = sup (3i^+z) 

c ' ) asup (x ) = sup (ax ) , for a 0 
n n 

d‘) asup(x ) = inf (ax ), for a<. 0. 
n n 

One of the most important properties of a vector 

lattice is the existence of an absolute value. For any 

X in X,we define x = sup(x,0), x = inf(x,0), and |xj = 

^ 

sup(x,-x) . X is the positive part of x, x is the negative 



7 


2 ar;t, and |xj is called the absolute value of x. Some 
properties of these quantities are given by 

Theorem 2 . Let X be a vector lattice. Then, for 
any x and y in X, 

1) x= X + X 

2 ) inf (x^ , -X ) =0 

3) |x|= x^-x 

4) Ixl^O and jx|= 0 if and only if x = 0 

5) iaxl=taf-|xj for all real a 

6) I x+yl 4 |x| + lyj 

(The proof can also be found in [6] , p. 220) . 

From the definition of x and x it is clear that 
+ — 

X >y 0 , X 0, so part 1) of this theorem says that any 

element in a vector lattice can be written as a difference 

of elements in the positive cone. That is, X = K - K. 

Such a cone /is called reproducing or generating . 

We will now discuss a natural topology that can 

be introduced into a PL space. The topology is natural 

in the sense that it is defined in terms of order concepts 

and is a vector topology. First, recall from the theory 

of linear topological spaces the following basic theorem. 

(See [17] , pp.34,35) . 

Let X be a topological space , and let B 
be a local base. Then 

1) for TJ and V in B there is a W in B such 
that W c U 0 V ; 

2) for U in B there is a member V of B 
such that V + V c U; 

3) for U in B there is a member V of B 
such that aV U for each scalar a with 
mi£l; 

4) for X in X and U in B there is a scalar 
a such that xeaU; 

5) for U in B there is a V in B and 
a circled set W such that V<^W<^U. 

6) If X is a Hausdorff space, then 
n £U;U e B} = [o} 



Conversely, let X be a linear space and B 
a non-void family of subsets which satisfy 
1) through 4) , and let T be the family of 
all sets W such that, for each x in W, there 
is U in B with x + U cr vf. Then T is a vector 
topology for X, and, B is a local base for 
this topology. If, further, 6) holds, then 
T is a Hausdorff topology. 

Here we call a set S circled if aS'^S for all a with |ajil. 
A set S is said to absorb a set V if there exists an ac,>0 
such that avcs for all O^a<:ao. The next definition 
is due to Namioka [20] . 

Definition 2 . Let X be a PL space, and let B be 
the family of all order bounded subsets of X. Let be 
the family of all subsets of X which are convex, circled, 
and absorb every member of B. Then the topology for 
which Xt is a local base is called the order bound topology . 

To justify this definition, it must be proven that 
XI does in fact define a unique topology. 

Lemma 1 . The family 11 in the preceeding definition 
is a local base for a unique locally convex vector top- 
ology on X- which is finer than any other locally convex 
vector topology for which order bounded sets are topolog- 
ically bounded. 

Proof . It is sufficient to verify that 11 satisfies 

conditions 1) through 4) of the theorem stated above. 

But, 1) is true since U fl V is convex, circled, and given 

SCLX, if a S cr-U, a Sciv then a S c-U nv where a =min(a ). 

1 2 3 3 1 2 

Condition 2) holds with V =)^U, since U is convex. Finally 
3) and 4) follow from the circled and absorbtion properties 
The last part of the theorem is clear. 

Very closely related to the order bound topology 
is the concept of relative uniform convergence, as defined 
by Birkhoff [6] . 
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Definition 3 . A sequence in a PL space X is 

said to converge relative uniformly to x* if there exists 
an element u ^0 in X and a sequence real numbers, 

such that a ^ a ... ^0, lim a =0, and 

1 2 h-va n 

-a ui-x - X* ^ a u. 
n n n 

The relation between this convergence and the order 

bound topology is given by a theorem of Gordon ([9],p.421). 

Theorem 3 . The order bound topology is the finest 

locally convex topology such that if converges 

relative uniformly to x* then also converges to x* 

in the order bound topology. 

Proof . Let T be any topology such that order bounded 

sets are topologically bounded. Let converge to 

X* relative uniformly. Then - a u£x - x*i-a u for some 

n n n 

u 0 and ^ 0. Let V be any open set in T and let 

B = fx6X ; -u£x^.u] . Then x - x* 6 a B . But B is order 

bounded, so V absorbs B, i.e., aBC-V for all small a. 

Hence, x - x* 6 V for large n. 
n 

It is not true, in general, that order bound conver- 
gence implies relative uniform convergence. Take, for 

2 

example, the space (E ,K^) considered above, with x = 

2 n 

Since the order bound topology is a vector top- 
ology, it follows that 0 in this topology. But, 

[x^^ is not order bounded so clearly there is no u such 

that - a U4X ia u, where a 0 . There is , however , a 
n n n n 

very wide class of PL spaces in which order bound con- 
vergence is equivalent to relative uniform convergence. 
Included in this class are those spaces which have an 
order unit; 

Definition 4 . An element z in a PL space is called 
an order unit if z ^ 0 and , for any x in the space there 
is a real a > 0 such that - az i x ^ az . 

In other words, we call z an order unit if [-z,z] is 
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radial at zero. 

It is a well-known fact that the Minkowski functional 
for a convex, circled set which is radial at zero is a 
semi- no 2 nn. This fact allows a very .useful character- 
ization of the order bound topology: 

Theorem 4 . If (Z,K) is a PL space which has an 
order unit z , then the order bound topology on Z is the 
semi- norm topology given by the Minkowski functional 

p(x) = inf {a : xea[-z,z]^ . 

Proof . As noted above , p is a semi- norm on Z . 

Let S = [x : p(x)<r] . Then Sc:r[-z,z]cs ,£>0- 
r L J r r+£ 

Hence, since [-z,z] is absorbing, so is S . Also, S 

r r 

is convex and circled so S 6 *U , where is the local 

r 

base for the order bound topology. Furthermore, each 

is order bounded, and every U e tl absorbs order bounded 
sets, so every U e U- contains some S^. Therefore, the 
topology determined by tC is the same as the topology 
determined by J . 

In order for p(x) to be a norm, we need an additional 
hypothesis . 

Definition 5 . A PL space is called almost Ar chime d- 
ian if -ax.iy.tax for some x^O, and all a>0, implies 
y == 0. 

Corollary . If a PL space has an order unit, then 
the order bound topology is a norm topology if and only 
if the space is almost Archimedian. 

Proof . If the space is almost Archimedian, then 
p(x) =0 implies -az^x^az for all a> 0, hence x= 0. 
Conversely, if p is a norm, then the topology is Hausdorff. 
But -ax 4 y^rax for all a > 0 implies that y e U for every 
U in the local base for the order bound topology. Since 
this topology is Hausdorff, y ~ 0. 



11 


2 

To illustrate these results / consider E with the 
positive cone K = | (x,y) : x > 0 or (x = 0 and y ^ 0)J 

Then the point (1,1) is an order unit, and so the order 
bound topology is given by the semi-norm 

p(x,y) = inf ; (x,y) € a [ (-1,-1) , (1,1) ] J 
= inf l^a : (-a,-a)^ (x,y) i (a, a) J 
hence p(x,y) = Ixf. This space is not almost- Archimedian 
because, if a = (1,1) and b = (0,1) then -oia 5 b ^ aa for 
all a > 0. 

Using the semi-norm defined in theorem 4, we can now 
prove the equivalence of order bound convergence and rela- 
tive uniform convergence. 

Theorem 5 . If a PL space has an order unit z, then 
relative uniform convergence is equivalent to order bound 
convergence. 

Proof. Theorem 3 shows that if x x relative uniform- 
n 

ly, then in the order bound topology. Now, if 

X X in the order bound topology, then p (x - x)-^0 as 
n n 

n->co . But, p(x - x) = inf f a : (x - x)ea[-z,z]| , hence 

n L n 

there exists a sequence a 0 so that x - x fc a [-z,z] . 

n n n 

i.e., -a z^x -xia z. 
n n n 

As an indication of the close connection between the 

ordering in the space and the order bound topology, we 

prove a theorem in which an order concept (tr -completeness) 

implies a topological concept (topological completeness) . 

Theorem 6 . If a PL space with order unit is a~ -complete, 

then the order bound topology is topologically complete. 

Proof . By theorem 4, the order bound topology is a 

semi-norm topology, hence completeness is equivalent to 

sequential completeness. Let { Cauchy sequence; 

i.e., X - X 0 as n,m-^c30 . By theorem 5, this implies 
n m 

-a zix-x4a z 
n,m n m n,m 



where a 0 as - But then 

n,m 

X - a z t X i a , z + X, 

1 n,l n n,l 1 

so { } is order bounded , and 

sup ( - a z { ^ sup (x - X ) <• sup a z I 
^ n/iti-' nvm n iti n%.mLn,in j 


By theorem 1, this implies 



Let u = sup f X ] . Then u. ^ u„ ^ . . . > inf j x } , so if 
m n>,m t ni 1 2 ■^nini 

X* = inf I u \ , then 0 i; u - x sup \ a { z and 
m m J mm n>>Tr. t n,m J 

x*~x 4u - X z 

m m m m 

where a = sup |a {--^Oasm-^co. Similarly, taking 
m n^iTi^ n,m-^ 

infima, we can show 


where x^= 


X - X. 4 a z 
m * m 

sup inf I X 1 . But then 
m n ?r m t n J 


X*- x.= (x*“ X ) + (x - X. ) 2a z 
* m m * m 

where a -#■ 0. Thus x* = x^ and 
m * 

- a z ^ X*- X 4 a z 
m mm 

hence x^-4 x* relative uniformly. Again applying theorem 
5, the proof is complete. 

As a final comment on PL spaces which have an order 
unit, we observe that these spaces are exactly those 
used by Schroeder [23] in his work oh operators with 
positive inverses. In this paper, Schroeder defines 
another type of ordering by setting x»0 if, for every 
z in the space, there exists an a > 0 such that - ax ^ z.i ax 
Hence "zp^)0" is equivalent to "z is an order unit." This 
ordering is not a partial ordering, in the sense of defini 
tion 1, because it is not true that 0»0. Some basic 
properties of this ordering are; 


Lemma 2 . If (Z,K) is a PL space with an order unit. 



13 


then 

1 ) x »0 and y» 0 imply ax + Py »0 for a 0 , p-> 0 , 
and a + p > 0 . 

2 ) x >0 and y»x imply y »0 

3) x»0 and y^x imply y»0. 

Proof . 

1) Let zez. Then for some Tl^,T| 2 ^ 0, -Tl^x^z^Tl^x 
and -Tj^Y i z i H^y . If either a or p are zero, the result 
is clear. Assume both are non- zero and let 1 ) 2 = 

Then 

-T\ (ax + Py) -^X - %y 4 ^ z i '5«x + '^i.y ^ (ax + Py) . 

^3. 3 3 . d 

2) If zeZ, then for some T|^0, -T) (y-x) 4 z 4 Tj (y-x) . 
But X 0 so -Tly<:-Tly + Tlx 4 z S;Tl(y-x) £: Tly, hence y^y-O. 

3) Let z = y-x. Then z 5 . 0 and y-z = x»0, so y»z. 

Now apply part 2) to get y»0. 

Partially Ordered Topo.logical Linear Spaces 

In the previous section, it was shown that we can 
start with a PL space and define a topology on it which 
will give a topological linear space. In most applications 
hgwever, a linear space is given which already has one or 
more well- known topologies, and it is not always clear 
how these topologies are related to the order bound top- 
ology. An alternative procedure for developing this 
theory, which avoids this problem, is to start with a 
topological linear space in which a partial ordering is 
defined, and then try to prove the necessary relations 
between the topology and the ordering. This is the method 
used by Krasnoselski [18] for Banach spaces and by Schaefer 
[21] for locally convex spaces. It will be shown, however, 
that even the most basic relations cannot be proven without 
some additional assumptions . One such relation which is 
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always very helpful is that the limit of a sequence of 
positive elements should also be positive. For this 
reason, we introduce the following definition. 

Definition 6 . A partially ordered topolocrical linear 
space ( PTL space) is a PL space with a locally convex 
vector topology such that the positive cone is a closed 
set. 

We will use (Z,K,T) to denote a PTL space Z with 
closed cone K and locally convex vector topology T. The 
fact that the cone is closed also implies that intervals 
[a,b] are closed sets. 

A PL space with its order bound topology is not 
necessarily a PTL space. Take, for example, the space 
E with K = ^ (x,y) : x> 0 or^ x = 0 and y^Oj . In the 
previous section, We showed that the order bound topology 
for this space is determined by the semi- norm p(x,y) ==Jx/ 
hence K is not closed. 

We will now list some common PTL spaces .which will 
provide us , throughout the remainder of this chapter , 
with examples and counter- examples . 

1) C[0,1], real valued functions, continuous on [0,1], 
T the topology given by the norm Ilf ii = max)f(t)j , 
K = {f : f(t):> 0 for t e [0,1]} . 

2) C^[0,1], real functions with n continuous deriv- 
atives on [0,1], 

Tq the noimi topology with il f Ii = max lf{t)l ^ 

T the norm topology with |)fll = max jf^^}t)| 
n 

K = ^ f : f (t) ^ 0 for t 6 [0,1] J 

3) BV[0,1], functions of bounded variation on [0,1], 

T given by the norm Ii f 11 = ff (0)j + V(f), where 

V(f) is the total variation of jf | , 

K = [f : f (t) ^ 0 for t 6 [0,1] } 



15 


4) L-^[0,1] , 0 < p < 00 

T given by the norm Ij.f j| 


K 


: f (t) ^ 0 a .e . I 


■d'' 




f l^dt 


5) L*[0,1] , bounded measurable functions on [0,1] 
T given by the norm llfll = ess sup lf(t)\ 

K = : f(t)>0 a.e.^ 

6) E^, real n-dimensional space 


r . 1 

. — / / • • • / ^ ) » x.^0, x~ l,2,«a*,nf 

i 1 2 n 1 

= i(x,,x^,...,x ) : x.XO, i = 1,2,... ,n-l, x = 0 r 
t. 1 2 n 1 n ^ 


T given by ||xl| 
K 
K 


7) H(S ), real valued functions which are harmonic in 

2 f 2 2 1 

the open unit sphere S = |(x,y) : x+y < Ij , and bounded on 

2 

the closed unxt sphere in E . 

T given by the norm llfll = lim max lf(x,y)l 
■ i 

K=|^f : f(x,y)^0 for x^+ y^^ 1 ^ 

It is simple to check that all of the above examples are 

PTL spaces. Using them, we can easily show that the 

closedness of the positive cone is not, in general, a 

strong enough connection between the ordering and the 

topology. Consider, for example, the following properties 

of sequences of real numbers: 

A) X, 4 x^^ X- 4 . . . 4 X* and sup(xl=x* implies lim x = x*. 

12 3 V ni . n 

B) lim x^= 0 implies that there exists with 

C) 0 X 4 y and lim y = 0 implies lim x = 0. 

n -^n n n 

Unfortunately, these statements are not true for all PTL 
spaces: 


a) In (C[0,1],K,T) letx^(t)= -t^. Then x^ x^ ^ . . . 

and sup (x \ - 0, but )/x || = 1, all n, so lim x 
t n-> n n 

does not exist. Hence A) does not hold. 

b) In (L^ [0,1] ,T,K) let x (t) = n forr|r,4ti-^ 


^ 0 , 


n 


and 
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zero elsewhere. Then lim II x II - 0 but clearly, 

n 

property B) does not hold. 

c) In (C^[0,1] ,T^,K) let x^ (t) = ^ y^(t) = . 

Then 0 x & y , and lim y = 0, but in the T, norm 
n ^ ^n-1 ^ 

II X H = max It^-t 1 + max jt 1 =i + 1> 1, hence x 

n I I I II 

does not converge to zero. 

The remainder of this section will be devoted to a 
brief discussion of certain types of PTL spaces in which 
some of the above statements are true. 


Definition 7 . A PTL space is called regular if every 

order bounded increasing sequence has a limit. 

Examples of regular PTL spaces are (E^,T,K^), (E^,T, 

K^) , and (L^ [0, 1] ,T,K) , whereas (C^[0,1] ,T^,K) and (C^[0,1] , 

T^,K) are not regular^ as was shown in example a) above. 

If ^z^^ is a monotone increasing sequence, and 

lim z = z* exists, then for any n ^ k. implies z z . 

n 0 0 n ko 

Hence z* = lim z z, , i.e., z* is an upper bound on f z ^ . 

n ko n j 

Moreover, if w is any other upper bound, then z^4 w and 
hence z* = lim z^4 w, i.e., z* = sup z^ j . We have shown 
that in any PTL space, the closedness of the positive 
cone guarantees that, if a monotone increasing sequence 
has a limit, then it also has a supremum. In a regular 
space, the converse of this is true, i.e., if a monotone 
increasing sequence has a supremum, then it also has a 
limit. It is important to note that the definition of 
regularity involves both an order concept (monotone bound- 
edness) and a topological concept (limit) . 

Definition 8 . If the positive cone has an interior 
point, then the PTL space is called solid . 

Examples of solid spaces are (C[0,1],T,K) and (E^, 


K^,T) . The first has f(t)=l as an interior point of K, 
while (1,1,...,!) is an interior point of K^. The spaces 
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p 

(L [0,1],T,K), 0<p<oo , are not solid because-, given 
any f £ K, and any L > 0, there is a g K such that }(f-glU t 
An equivalent characterization of a solid space is given 
l^y 

Lemma 3 . A space is solid if and only if there exists 
an open set 0 containing the origin, with 6 c [-a, a] , for 
some a» 0. 

Proof s If 0 6 0 c:- [-a, a] , then a € 0 + a c [0,2a] a k, 
hence a is an interior point of K. Conversely, if ae 0c-K, 
then 0 6 [0-a O (-0+a)] c: [-a, a] . 

The theory concerning order units which was developed 
in the proceeding section can be applied to solid spaces 
because of the following result. 

Lemma 4 . If (Z,T,K) is a solid PTL space, then z^ is 
an order unit if and only if z^ is an interior point of K. 

Proof . If Zq is in the interior of K, then z^e 0c^K, 
where 0 is an open set. Let z be arbitrary in Z. Then 
Tlzr^o as 0 and since -0+z^ are both. neighborhoods 

of 0, for some Tl^> 0, 

T|z € (©-Zq) ^ (-0+Zq) c: [-Zq,Zq] 
for all Tj4T]^. That is, Tlz e [-Zq,Zq] and hence z^ is an 
order unit. Conversely, if z^ is an order unit, and 
z is an interior point of K, then for some T], T\z £= z . 

JL U 

But z^€- 0CK so Tlz^e T10CK and 

Zq= T|z^+ (Zq- ^z^) C Tie + (Zq~ Tlz^) C K, 
where Tie + (Zq- "Rz^) is an open set. Thus z^ is an interior 
point of K. 

A consequence of this lemma is that if a space is 
solid, then it has an order unit. The converse is not 
true, in general, as is illustrated by the following 
example. Let Z = C[0,1] , K the usual ordering, and T the 
topology given by the L^[0,1] norm. Then f (t) = 1 is an 
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order unit, but there is no interior point in K, as was 
pointed out earlier, hence (Z,T,K) is not solid. 

It is now possible to relate the topology in a solid 
PTL space to the order bound topology. First, however, we 
need some basic facts about, these spaces. 

Lemma 5 . If (Z,T,K) is a solid PTL space, then 

1) K is reproducing; 

2) every topologically bounded set is order bounded; 

3) every compact set is order bounded. 

Proof . 

1) Let Zq be an interior point of K and let z be 

arbitrary. By lemma 4, [-Zq,z^] is radial at 0, so for 

some T1>0, Tlz^^. z. Hence z = Tlz^- (Tlz^-z) where T|Zq and 
(Tlz^- z) are in K. 

2) If S is topologically bounded, and z^ is an interior 
point of K, then TIS [-z^,z^] for some T)>0, because [-z^, z^] 
contains an open set. (See the proof of lemma 3) . 

3) Every compact set is topologically bounded, hence 
is order bounded because of part 2) . 

Theorem 7 . If (Z,T,K) is a solid PTL space, then T 
is finer than the order bound topology. 

Proof. Let be the local base for the order bound 
topology, and let^li^be a local base for T, By lemma 3, 
there must be order bounded sets in ‘U /' , and every U 6 “U 
absorbs such sets, hence every contains some WG*U/ . 

Thus is finer than ‘U . 

An important consequence of this theorem is the 
following result. 

Corollary . In a solid PTL space, all sequences have 
property B) . That is, if lim x^= 0, then there exists 

with yj^>.Y 2 > ... >,0, inf { =0, and -y^«. y^. 

Proof. If lim x =0, then x 0 in the order bound 

n n 
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topology, hence by theorem 5, ^ relative uniformly. 

Thus, there exists 11^^^ 0, and u 0 such that 

inf f T| ] = 0 and -T] u i x 4 Tj u . 

The last type of PTL space we will consider is defined 
by 

Definition 9 . A PTL space is normal if, given any 

local base for the topology, there exists an Tj > 0 so 

that if Os-zfcUeXt, then [0,z] c nu. 

The spaces (E^,T,K) , (L^ [0 , 1] ,T,K) and (C[0,1] ,T,K) 

are normal, while (C^[0,1] ,T ,K) and {BV[0,1] ,T,K) are not. 

n 

If T is a locally convex topology, then there is a family 
^p^y of semi- norms such that the family of sets of the 
form f z ; p (z) < r } , for r real, is a local base for 
the topology T. Hence, the definition says that there 
exists an T] > 0 so that if 0 4 x $: y and p (y) < r then p (x) < Tlr. 

0 £> Gt 

From this observation, we can prove several statements 
which are equivalent to normality. 

Theorem 8 . Let (Z,T,K) be a PTL space. .Then each of 
the following statements is necessary and sufficient for 


the space to be normal. For any continuous semi- norm p, 

1) there exists an Tj > 0, which is independent of 
p, such that p(x)iTlp(y) for 0 4x-ty. 

2) (S + K) n (s - K) c: ns where n is independent 

P P . P 

of p, and S = f z : p(z) <. 1 ^ . 

P 

3) there is a continuous semi- norm q, equivalent 
top, such that q(x)^q(y) for 04xi:y. 

Proof . We first observe that the collection of all 
continuous semi- norms defines a local base, hence the 


family |Pq ] t in the remark following the definition, , can 
be this collection. 

1) If Z is normal , and 0 ^ x < y then p (y) < (x) 

would imply p (x) < np (y) P (x) which is impossible, so 
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P (y) ^ p (x) , Conversely, if 0 -t x y implies p (x) < T]p (y) , 
where Tj is independent of p, then clearly p (y) < r implies 
p(x)<T|r, hence normality. 

2) If (Z,T,K) is normal, and z e (S + K) ^ (S - K) , 

> P P 

then z ~ u+x = v-y where p(u) <. 1, p(v) 4 1, and x,y e-0. 

But then 0 4 x x+y so by 1) , 

p (x) ^ Tip (x+y) = Tip (v-u) ^ Tl(p (v)+p (u) ) 4 2T1, 

hence p(z) = p (u+x) 4 p (u) + p (x) 4 1+2T1, thus z 6 (1+2T1)S . 

P 

Conversely, if U = (S + K) H (S - K) c US then p(z) < T1 for 

P P P p 

all z e U . But then, if 0 4 x ^ y and 0 < p (y) < r , letting 
P 

y*=|ty, x*=-^x, we have 0 s. x* sz Y* / P(y*) ^ and x*=y*+(x*- 
-y*) so X* 6- Up and hence p(x*) 4 T|. i.e., p(x) 4 Pr where 
P is independent of p. 

3) If every p has an equivalent monotone q, then 

part 1) is true with T] = 1 . Conversely, if Z is normal, 

then S c u =:(S + K) n (s - K) c:T 1S . But S is radial at 
P P P P P P 

0, and hence U is a convex, circled set, radial at 0. 

P 

Thus the Minkowski functional q(z) = inf T1 : x e TIU^ ^ 
is a continuous semi- norm. Furtheimiore , 

a) p (x) = 0 implies q(x) = 0 since for such x, 

X G T|U for all Tl>0. Also, p (x) > 0 implies q(x) = 

P 

P (x)q(|io) 4 p (x) since . Hence, q (x) £ p (x) . 

b) By part 2) , p (U ) 4 k, but q(x) $ T1 where x eu , 

P P 

hence p (Xj^ 4 k. That is q (x) •5' T] p (x) . 

Thus for any xG Z, ^ p (x) 4 q (x) 4 p (x) so q is equivalent 

to p. Finally, if Oix^y, and p (x) 4 1 then '/>j^y eu implies 

*/^y ^ where u,v eu and a,b^K. But x=^y-(y-x) so 

= v-b- (y-x) = V- (b+/4( (y-x) ) where b+/^ (y-x) t K. 

Hence, J'jjX tU and so j^TlryGTlsjc, ^^TlixCrTlsj and 

therefore q (y) 4 q (x) . 

The last part of this theorem has an interesting 
consequence. Given any family j^P^j semi- noimis, the 
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theorem says that normality is equivalent to the existence 

of a family j of semi- norms with equivalent to 

and q monotone on K. Hence we have 
cx 

Corollary . A PTL space is normal if and only if 
there exists a local hase ^ for the topology , such that 
if 0 c X c U c , and 0 i y t x, then y <f- U. 

This is, in fact, the statement used by Schaefer to 
define a normal PTL space. (See [21], p.l21). If the 
topology is a norm topology, then part 1) of the theorem 
says that there exists an T] so that 0 ir x i y implies 
llxji T] 11 yU . This is equivalent to the condition used 
by Kelley and Namioka ([17], p.227), and Krasnoselski 
([18], pp. 20,24) to define a normal normed space. This 
theorem shows that these two definitions are the same. 

Some further properties of normal spaces which will 
be needed in the next chapter are: 

Theorem 9 . In a normal PTL space, 

1) every order bounded set is topologically bounded; 

2) the topology is coarser than the order bound top- 
ology; 

3) property C) holds. That is, if 0 £: x i y and 

n n 

lim y = 0 then lim x = 0. 
n n 

Proof . 

1) If S c: [a,b] then S'= S-ac[0,b-a]. If [ j is 
a family of semi- norms which defines the topology, then 

(S ' ) ^ Tip (b-a) , all a . Hence p (S) = p (S '+a) < (S ' ) + 

P„ (a.) Tip (b-a) + p (a) , so S is topologically bounded. 

Cu Or C6 

2) The order bound topology is, by definition, 
finer than any topology for which 1) is true. 

3) If 0 <x < y and lim y = 0, then for any p , 

n^ ■‘n -^n •^a 

p (x ) 4 T|p (y ) -> 0 as n . Hence, p (x ) -^ 0 for all 
u n Cfc n ot n 

a , and therefore , lim x = 0 . 
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Combining part 2) of this theorem with theorem 7, we 
see that the topology in a solid normal PTL space is 
equivalent to the order bound topology. Actually, we can 
prove a little more about such spaces, but first we need 
some more definitions. 

Definition 10 . 

1) A PTL space in which the topology is given by a 
norm || ■ n which satisfies /|x/j k liy|/ for 06x^y, where 
k is independent of x,y, is called a partially ordered 
normed linear space , ( PNL space ) . 

2) A PNL space which is also a Banach space is called 
a partially ordered Banach space , ( PB space ) . 

3) A PB space which is also a lattice in which the 
absolute value and the norm are related by Ij {xj Ij = /jx i| 
for all X, is called a Banach lattice . ( BL space) - 

Notice that PNL, PB , and BL spaces are all normal, 
since condition 1) of theorem 8 is satisfied. Furthermore, 
by this same theorem, any normal PTL space, where T is a 
norm topology, is a PNL space. That is; 

Theorem 10 . If T is a norm topology, then (Z,T,K) 
is a PNL space if and only if it is a normal PTL space. 

Now we can summarize some of the characteristics 
of a solid and normal space. 

Theorem 11 . Let (Z,T,K) be a PTL space which is 
both solid and normal. Then 

1) T is the order bound topology; 

2) (Z,T,K) is a PNL space; 

3) if (Z,K) is <r -complete, then (Z,T,K) is a PB space,. 

Proof . Part 1) was proven above, and 3) follows 

I 

from theorem 6. To prove part 2) it suffices to show 
that the order bound topology is a norm topology. But by 
the corollary to theorem 4, this is true if (Z,K) is 
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almost Archiraedian. Suppose that -ax y £ ax for some 
X -5- 0 and all a > 0. Then since K is closed, and T is a 
vector topology, letting a~*0 gives y^O and y^Q, hence 
we must have y = 0. That is, the space is almost Archimedian. 

We conclude this section with a summary of the spaces 
we have been using as examples. 


Lattice 

<r-comp . 

Regular 

Solid 

Normal PB 

Space 

(E^,K^,T) 

yes 

yes 

yes 

yes 

yes 

yes 

(e"^,K2,T) 

no 

yes 

yes 

no 

yes 

yes 

(L^,K,T) 

yes 

yes 

yes 

no 

yes 

yes 

(L ,K,T) 

yes 

yes 

no 

yes 

yes 

yes 

(C,K,T) 

yes 

no 

no 

yes 

yes 

yes 

(C,K,T^)^^ 

yes 

no 

no 

no 

yes 

3) 

no 

(C^,K,TJ 

no 

no 

no 

yes 

no 

2) 

no 

(BV,K,T) 

yes 

yes 

yes 

no 

no 

2) 

no 

(H,K,T) 

yes 

yes 

4) 

yes 

yes 

yes 

yes 

1) 

is given by the 

^1 

L norm; 

Ilf 11 = 

r lf(t)ldt. 
■^0 


2) The 

norm 

is these 

spaces is 

not monotone. 



3) This space is not complete. 

4) The regularity of this space follows from Harnach's 
theorem. 


Table 1 . PTL Spaces 


Spaces with Partially Ordered Norm 
Let X be a real linear space and suppose there is 
a mapping |H|from X into a PTL space Z, which satisfies: 

1) UXU ^ 0 for all x in X; 

2) iix/; = 0 only if x = 0; 

3) i/axii =lai ijxjifor all real a; 

4) II x+yi| £ IIX if + l/yii . 

Then X is said to be normed by Z,. This concept has been 
used extensively by Kantorovich ([14], also see [4]), who 
has proven a convergence theorem for Newton's method 
applied to operators in such spaces. In order to apply 
the results of the next chapter to these spaces, we will 
now define a topology on X which is induced by the partially 
ordered norm. 

Suppose the linear space X is noinned by a normal 
PTL space Z. Let be a local neighborhood base for 
the topology in Z, and, for each U 6 it let 

Q (U) = l^xtX: i/xl/tUj 

Then, the collection = {Q (U) i U t- Uj is a local base 
for a vector topology in X. This is true because we can 
assume that 11 has the property; O^x^yeUe-H implies 
X 6 U, for all Ueii and y eU, in which case, 

1) for any Q(U),Q(V), there is a WcuDV and hence 
Q (W) C Q (U) n Q (V) ; 

2) for any Q (U) there is Veil with V+VC-U, hence 

Q (V)+Q (V) c: Q (u) because if x^/X^tQCV), then // x^i) t- V, 

II x^lieV so 0 6 Kx^+x^ll i: 11x^11 + Ux^H and Ij x^ii +/|X 2 ff£-U, 
hence by normality, 1/ x^+x^li ^ U. i.e., x^+x^ fc Q (U) ; 

3) for any Q (U) , there is a Veil with aVc-U for all 
a with lal4 1. Hence aQ(V)^Q(U). 
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4) for any x 6 X, and any Q (U) , nxi/ & au for some a, 
hence x £ aQ (U) . 

Thus, by the theorem on local bases quoted earlier,??' is 
a local base for a locally convex vector topology. This 
topology will be called the norm topology induced by 
If Z is Hausdorff, then so is this topology, because, if 
x€ D Q (U) then i/x//e HU = {o| and, by condition 2) of the 
definition, this implies that x = 0. 

If Z is a PNL space, then the topology induced by 
Z is also a noimi topology. To show this, we use the fact 
that Z has a norm p which is monotone. Hence, the function 
q defined on X by q (x) = p( i/xij ) is a norm because: 

a) q(x) > 0 for all x in X; 

b) q (x) = 0 only if x = 0 ; 

c) q(ax) ==p(|/ax») = p(|al j/x// ) = I a/ q (x) ; 

d) Oi Mx+yl/ c jjxij + 11 yd , hence p(ilx+y|j)^ p (fixij+llyd 
p(ilx]|) + pOiyJi)/ i.e., q(x+y)4q(x) + q (y) . 

Furthermore, a local base for the topology induced by 

q consists of sets of the form ^x:q(x)i rj = |x:p (iixll) rj 
But these sets also form a local base for the topology 
induced by Z, hence these two topologies on X are identical 

Operators on PTb Spacaa 

The purpose of this section is to define convex 
operators and prove some properties of them which will 
be needed in the next chapter. These proofs^ will use 
an integral theorem of the form f (1) -f (0)= Jf ' (t) dt, and 
so we will first have to define the derivative and integral 
of an operator. These definitions do not make use of 
the ordering in the space and hence are given for topolog- 
ical linear spaces . Much of this material can be found in 
Vainberg [27] and Kantorovich and Akilov [16] . 
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Let X and Y toe locally convex topological linear 
spaces/ and let D toe a convex sutoset of X. If x^ is an 
interior point of D/ # then for any hex, x^+th € 

for small enough t, and hence if FjDCX-^^Y then F[x^+th] 
is defined for small t. (We use F:Dcx-^Y to denote an 
operator F defined on a sutose,t D of X, with range in Y) 

Definition 11 . If F:Dc:X-^Y and D^ and if the 

limit VF[x-,h]=lim 4 - /f [ x +th] -F [x^]] exists and is uni^^i^c 
O f* 0 ^ 0 0 ■' 

for all h in X, then F is said to have a Gateaux differential 
at Xq, and VF[xQ,h] is called the Gateaux differential in 
the direction h. 

From this definition, it is clear that VF[x,cxh3 = 
aVF[x,h] for any real a. If VF[x,h] is also additive 
in h, then the operator F' [x] defined by 

F' [x]h = VF[x,h] 

is a linear operator. (It is not always true that VF[x,h] 
is linear in h.) If F' [x] is a continuous linear operator 
then it is called the Gateaux derivative of F ato x. If 
SdD^ and F has a Gateaux derivative (G -derivative) at 
every point in S, then F is G -differentiable in S_. F is 
called continuously G-differentiatole in ^ if the mapping 
F';S->E(X,Y) is continuous, where E(X,Y) is the space of 
continuous linear operators from X into Y, with the weak 
operator topology . 

The G-derivative at a point is a generalization of 
the directional derivative. For this reason, it is to 
be expected that certain important results cannot be 
proved using this type of derivative. For example, an 
operator can have a G-derivative at a point without being 
continuous there, and, in general, the composite function 
theorem 


(FH) ■ [x] = F' (H[x] )H' [x] 
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does not hold for G-differentiable operators. By adding 
another condition to the definition of the G-derivative , we 
get the Frechet derivative, which has all the properties 
needed of a derivative. This added condition can be given 
for an operator defined on any topological space [19] , but 
since it will be used here only in normed spaces, we define 
it as follows; 

Definition 12 . Let F;DCX~»Y be G-differentiable at 
Xq£D®, where X and Y are normed linear spaces. If the 
operator F'[x^] satisfies 

lu.iiyj' irifi " ° 


then F is called Frechet differentiable ( F-differentiable) 

at x^. The operator F' [x.l is called the Frechet derivative. 

0 

If F is either G or P-differentiable in a convex 

set S, then F' is an operator from S into E(X,Y). If 

this operator is also differentiable, in the same 'Sense, 

then F is said to be twice G or P- differentiable. The 

derivative of F ' at x^ is denoted by P"[x ]. Note that 

0 -^0 

F" [Xq] :X-> E (X,Y) , hence F"[x^]{x) is a linear operator 
from X into Y. That is, F"[x^] can be interpreted as a 
bi-linear operator from X*X into Y. Higher derivatives 
are defined similarly. 

It is possible to define the integral of an operator 
FiX“^Y where X and Y are locally convex spaces. For our 


purposes, however, it will suffice to consider only the 
special case where X is the unit interval [0,1] . Let 


i=0,l,...,n, be a subdivision of [0,1], i.e., 0=tQ^ t^^ 

t ^ ... t - 1, and let | be any point in [t , t ] . If 
^ XX. jZ. KL -L 

the Riemann sums ^ ^ approach a unique limit. 


as max(|t _-t 1) goes to zero, independently of the 
iC * JL iC 

choice of the subdivisions and the points £ , then this 

ic 
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limit is called the Riemann integral of F, and is denoted 
by J F(t)dt. The reason we define the integral of an 
operator is to allow us to prove the formula F(l)- F(0) = 
J'F'(t)dt. If F:[0,l]-tY, where Y is a Banach space, and 
F is continuously G-differentiable, then this formula is 
indeed true. (See [16] , p. 666) . However, using PTL spaces, 
we can give other conditions on F and Y which will allow 
us to prove a result more useful to us than the Banach 
space theorem. In order to state these conditions, we 
first need some properties of operators defined on PTL 
spaces . 

Definition 13 . If F:Z-^W, where Z and W are PTL 
spaces, then F is called positive (F » 0) if F[z] ^ 0 for 
all z 0 . 

If F and G are two operators from Z into W, then 
we write F^GifF-Gisa positive operator. Thus, the 
ordering in the spaces induces an ordering between the 
operators . 

Definition 14 . An operator F is called monotone if 
z^^: z^ implies F[z^]^F[z^]. 

If F is linear, then F ^ 0 is equivalent to the mono- 
tonicity of F. 

Definition 15 . An operator F is called inverse positive 
if F [z] ^ 0 implies z ^ 0 , 

If F has an inverse, then F is inverse positive if 
and only if the inverse of F is positive. A linear operator 
which is inverse positive is, also one-to-one because, 
if F[z*:]=0 then, by definition, z* > 0 and also z*i 0, 
hence z*=0 . 

Definition 16 . An operator is order bounded if it 
maps order bounded sets into order bounded sets. 

Every monotone operator is clearly order bounded. 
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but not conversely. 

If X and y are elements in a linear space X, then the 
segment (x, x+v) is the set of points of the form x+ty, for 
0 ^ t 1. 

Definition 17 . An operator F:Z-^W is uniformly differ- 
entiable on the segment ( z , z+h) if F is G- differentiable 
at every point in the segment/ and there is an operator 
w:EO,l]-^W such that (-w) is monotone, lim w(t) = 0, and 
-w (|/^t } ^ (F [z+ (t+At)h] -F[z+th] ) -F' [z+th]h w(!/itO 

for all t, ^t with 0 t 1 and 0 tt-s^t 1. 

This concept has been used by Kantorovich [14] for 
operators in spaces normed by a PTL space. In this case, 
the condition becomes ; 

jj ^(F[z+(t+ t)h] -F[z+th] ) -F' [z+th]h|l i w(jAtl) , 
where the range of w is in the space which norms the range 
of F. The relation between uniform differentiability 
and continuous differentiability is given by; 

Theorem 12 . Let F :D ft Z where Z and W are PTL 

spaces, D is convex, and F is continuous in D. If W is 
normal and F is uniformly differentiable on every segment 
in D^, then F is continuously differentiable in D . If 
W is solid and F is continuously G- differentiable in 
then F is uniformly differentiable on every segment 
in D . 

Proof . Let h be arbitrary in Z and let D . Then 

F' [z^]h - F’ [z^lh = ^(FEz^+Athl-FEz^D-F' [z^lh - 

^ (F[z^+4thl -F[z^] ) -F' [z^]h + 

At (F[z^+Ath] -FEz^+^thl+FEz^] -F[z^] ) 

4 w^ClAtl) + w^(lAtl) + 

^ (F[z^+Ath] -FEz^+'^th] + F[z^]-F[z^]) 

where At is small enough that z^+Ath and z^+Ath are in 

Similarly, we can show that 
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F' - F’ [z^]h>^ -w^ClAtl)- w^dAt!) + 

^ (F[z^+Ath]-F[z2+Ath]+F[z2]-F[z^I) . 

But, w. (At)-> 0 as At-^0, F is continuous, and W is noinmal, 

1 

so it follows that F’[z]h is continuous in z.. Conversely, 
if W is solid and F is continuously differentiable then, 
for (z,z+h)<^D^, the function 

G (t ,At)= ^ (F [z+ (t+At)h] -F [z+th] ) “F‘ [z+th] h 
is continuous in t. Thus, for fixed At, the set 

[G(t,At) : 0 i t i l] 

is compact. But compact sets are topologically bounded, 
and by lemma 3, there is an order bounded open set in W. 

Thus there is a positive in W; and a real function f, 
such that I^G (t,At) ;0 -6 t i ij C f ({ Atl ) [-Wq,w^] . i.e., 
-f((At))wQ< G(t,At)ir f(!Atl)wQ. Since G(t,At)'^0 as At--?0, 
uniformly for Oi tt 1, we can assume f is monotone decreasing 
and lim f (At) = 0. Setting w(At) = f(At)w^ completes the 
proof. 

The hypothesis that W is solid in the last part of 
this theorem is necessary. To show this, consider the 
following example. Let F:[0,1]— ?L [0,1] be given by 
F[t] (x) = (t-x)^ . Then F is continuously differentiable, 

with F' [t]= “3 (t-x)^, but the difference ^(F [t+At] -F [t] ) -F ' [t] 
is not order bounded, hence no w(At) can exist. That is. 


F is not uniformly differentiable. 

We can now prove the important result; 

Theorem 13 . Let F:[0,l]-^Wbe uniformly differentiable 

on [0,1] , where W is a normal PTL space. Then | F' (t)dt 

r' 

exists, and F(l)- F(0) =jF'(t)dt. 

Proof . Let [ ^ partition of [0,1]. Then 

(\0 < 
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iUi 




Thus , F (1) ~F (0) -^F ' (t^) 


fe=t; 


t?-o 
i: w (max ! t. 


k+l’~'*^k*^ 


Similarly, we can show 

F (1) -F (0) -£f ' ( t^) ^ ^ ' 

by normality, as the size of the partition goes to zero, 
the summation converges to F(1)-F(0), and the conclusion 
of the theorem follows. 

The form in which this result will be most often used 


is; 

Corollary . Let FjDc:Z'-?'W where Z and W are PTL spaces, 

W is normal, and F is uniformly differentiable on the 
segment (z,z+h)c:D^. Then ^ 

F[z+h] -F [z] = ^F' [z+th]hdt. 

O 

Proof . Apply the theorem to the operator f (t)=F [z+th] . 

Using the above theorems, we can now prove some 
important results about convex operators. First consider 
a real valued function f(t) defined on some interval [a,b] 
of the real line. If f is convex, then it has the following 
properties, any of which may be used to define convexity. 

a) f (Tlx^+d-lDx^) ^ Tlf (x^) + (l-'n)f (x^) for 0 t Tj - 1 and 
x^,x^ [a,bl . 

b) If f ' (x) exists for x e- [a,b] , then for x,x+h 6 [a,b] , 
f ■ (x) ^ iVtf ( 2 i+h)~f (x)] . 

c) If f ' ' (x) exists for x 6 [a,b] , then f ' ' (x) 0 for 

all X (=■ [a,b] . 

These statements can be interpreted in any PTL space. 
Let F:Do z-^W where Z and W are PTL spaces, and D is a 
convex subset. 

a') F[Tlz +(1-Tl)z^] TlF[z.l + (l-Tl)Ftz„] for 0 T1 ^ 1 and 
1 ^ < 1 . ^ 

b') If F is G- differentiable in D, then for z,z+h6-D, 
F' [z]h^: F[z+h] -F[z] . 
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c') If F is -twice G- differentiable in D, then F' ' [z] ^ 0 
for all z D. 

For differentiable functions, a) and b) are equivalent, 
and we also have 

Lemma 6 . If F is G- differentiable in D then a ' ) 
and b ' ) are equivalent . 

Proof » If b’) holds, then for x,y6D, 0 tT) ^ 1, we 
have z=Tlx+ (l-Tl)y e D and 

P[y] -F[z] F' [z] (y-z) 

F[x] -F [z] ^ F' [z] (x-z) . 

Multiplying the first by (l-T]) , the second by Tl, and adding, 
gives, TjF [x] + (l-T]) F [y] -F [z] F'[z] ('Tlx+ (1-Tl) y-z) 

= F ’ [z] (z-z) = 0 

hence a') holds. Conversely, if a ' ) is assumed to be 
true, then for 0 t 1 and x,yc-D, 

F[tx+(l-t)y] tF[x] + (l-t)F[y] . 

Hence, (F[tx+ (l-t)y] -F[y] ) ^ F[x] -F[y] , Letting t-^0, 
the left side converges to F* [y] (x-y) , hence b') holds. 

Condition b') is used by Collatz [7] to define a 
convex operator. In view of the above lemma, however, 
we use the more basic property a') • That is. 

Definition 18 . If F:DCZ->W where Z and W are PTL 
spaces, D is a convex subset, and F satisfies a'), then 
F is convex in D . 

In the next chapter, we will need a property of 
convex operators which, in certain spaces, is equivalent 
to a' ) . 

Lemma 7 . If Z is a PTL space, W a noimial PTL space, 
and F is uniformly differentiable in every segment in D, 
then F is convex in D if and only if 

d’) F' [u] (v-u)^F' [v] (v~u) for all u,v in D. 

Proof. If F is convex then b') holds and hence we have. 
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F ' [u] (v-u) 4 F [v] -F [u ] L F ' [v] (v-u) . Conversely/ if d ’ ) 
holds, then by the corollary to theorem 13, 

F[u+z]-F[u]= f F' [u+tz] zdt . 

But/ by d')/ F' [u] tz i: F ' [u+tz] tZ/ hence, if t^O, then 

j F’ [u+tz] zdt ^jF‘[u]zdt = F'[u]z. Thus b') holds, 
c o 

Condition c'), (i.e., F''[z]^0), is not, in general, 

related to convexity. In for example, a twice differ- 

n X 

entiable functional F:Dce -:?E is usually called convex 
if the quadratic form £ is positive definite, 

t I — J ^ 

J * P 

whereas, the condition F''[z]^ 0 means that for 

all i, j-1, 2, . . . ,n.' These conditions are clearly not 
equivalent. In fact, they are not even related in the 
sense of one implying the other. The condition of positive 
definiteness can’be generalized to 

e') F is twice G- differentiable in D and F''[z]hh-?-0 
for all z, z+h in D. 

Lemma 8 . Let F;Dcz-^Wbe twice G- differentiable 
in the convex set D, where Z and W are PTL spaces. 

1) If F is convex, then e') holds. 

2) If W is normal, and F* [z] is uniformly differentiable 
on every segment in D, and e’) holds, then F is convex in Do 

Proof . 

1) F' ' [z]hh= lim J (F' [z+th]h - F' [z]h) . But convexity 
implies, by lemma 7, that F'[z+th]th - F'[z]th^O, hence e'). 

2) F* [u+h]h-F' [u]h = J' F' ' [u+th] hhdt ^ 0 , and hence, 

o 

again using lemma 7, we conclude that F is convex. 

Notice that a'),b'),d'), and e') make sense even if 
the domain space has no order relation, while c') does not. 
Operators satisfying c ' ) do have some properties which 
are very similar to b’) and d'). 

Lemma 9 . Let F:Dc Z where W is a normal PTL space, 

Z is a PTL space, F is twice uniformly differentiable in 
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every segment in the convex subset D, and F' ’ [z] -S- 0 for 
all z in D. Then 

1) F ' [u] ^ F ' [v] for u .s- V in D . 

2) F’ [u] (v-u) F' [v] (v-u) for u^v or v^u, u and v in D . 

3) F' [u] (v-u) F[u] ~F[v] for u 6 V or V 4 u , u and v in D . 
Proof s 

1) Let z ^ 0 and use theorem 13 to write 

F ’ [v] z-F ' [u] z= f F ' ' [u+t (v-u) ] z (v-u) dt » 0 - 

2) If ui; V then 1) implies F' [u] (v-u) <• F' [v] (v-u) . 

If u^ V then F’ [v] (u-v) i F' [u] (u-v) , so F' [v] (v-u) ^ F' [u] (v-u) . 

3) By part 2 ), F ' [u+t(v-u) ] (v-u) =:^F'[u+t(v-u)](u+t(v-u)- 

u)^ :^F' [u] (u+t (v-u) -u) = F' [u] (v-u) . Hence by theorem 13, 

F [v] -F [u] = j F ' [u+t (v-u) ] (v-u) dt ^ F ' [u] (v-u) . 

0 



CHAPTER II 


NEWTON'S METHOD 


Let F;DCZ->W where Z and W are PTL spaces and F is 
a nonlinear operator. If F is G-differentiable in D^ and 

• r ■» 0 

xf there is a sequence { ^ which satisfies the 

linear equations 

P'[z ] (z - z ) = “F[z ], 
n n+1 n n 

n = 1,2,..., then F is said to have a Newton sequence at z^ . 
We are interested in finding conditions on a convex operator 
which will be sufficient to .guarantee that it has a Newton 
sequence which converges to a zero of the operator. Because 
of the similarities pointed out in chapter I (lemma 9) , we 
will also consider operators whose second derivative is 
positive . 

The theorems which will be proved differ from the Newton 


method theorems of Kantorovich [13] in several ways. First, 
we use only the G-derivative, whereas the results of 
Kantorovich require the operator to be twice F~dif f erentiable . 
Secondly, instead of Banach spaces, we will use various 
types of PTL spaces, and by using these spaces, we are able 
to replace bounds on the norms of the first and second 
derivatives by hypotheses of the foim -F' [z]4 P , where P 
is a linear invertible operator. On the other hand, 
Kantorovich's theorems imply that P' [z^] has a continuous 
inverse, a fact which is not true in our case, as will be 
shown later by an example. Some related results of Baluev 
[2,3] and Slugin [24,25] will also be discussed. These 
results, which pertain to Chaplygin methods, can also be 
applied to Newton's method, however, it will easily be seen 
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that they are weaker theorems than those which will now be 
proven. 

Before giving the main result, we will prove three 
lemmas. The first two show that in order for a convex 
operator, or an operator with positive second derivative, 
to have a Newton sequence, it is necessary for there to be 
a point at which the operator takes a positive value. 

Lemma 1 . Let F:Dc:Z->W where Z and W are PTL spaces, 

F is convex and G-differentiable in D^, and ZfZ are 

0 . ^ ^ 
poxnts xn D whxch satxsfy 

(1) ^^l” ^0^ “ 

Then F[z^] ^ 0. 

Proof . Convexity implies F' [z^] (z^^-z^) ^ F[z^]-F[Zq] . 

Subtracting this from (1) gives F[z^] •>0. 

A similar but slightly weaker result holds for operators 

with positive second derivative. 

Lemma 2 . Let F:DcZ-^W, where Z and W are PTL spaces, 

W is normal, F is twice uniformly differentiable on every 

segment in D, and F' ' [z] ^ 0 for all z <e D*^. If 

and either z„4 z, or z, z^, then equation (1) implies 
0 110 

[z^] ^ 0. 

Proof . By lemma 9, chapter I, the equation 
F' [Zq] (z^- Zq) 4 F[z^3 - F[Zq] 
is valid. Hence, as in lemma 1, F[z^3^0. 

The next lemma is a fixed point theorem of Kantorovich 
[12] which will be used extensively throughout this chapter. 

Lemma 3 . Let V:Z~^Z where Z is a regular PTL space, 
and V satisfies 

1) V is continuous ; 

2) V[0] ^ 0 

V[z*] ^ z* for some z* 0; 

3) if <iz ^0 then V[z+az] ^ V[z] for any z e Z. 
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Then V has a fixed point in the interval [0,z*] . 

Proof . Let Zq=0, V[z^] . Then z^=V[Zq] 0 = z^ 

and z = V[z ] <r V[z*] < z* , hence z, (r [z^,z*] . If z is in 
10 1 0 n 

then z = V[z ]>V[z A = z , and 
n-1 n+1 n n-1 n 

z ^ = V[z ] Sr V[z*] S: z* , 
n+1 n 

hence z € [z ,z*] . Therefore, by induction, 0 ^ z^ s z, ^ 
n+1 n 01 

z 4...^z i:Z t ...i-z*. Since Z is regular, lim z = z ' 
exists, z' 6 [0,z*] and V is continuous so V[z'] = z‘. 

We are now ready to state the main result. 

Theorem 1 . Let F:Dcz + w where Z and W are PTL spaces, 
Z is regular and normal, and [z*,z*] is an interval in 
such that 

1) F is continuous, G-dif ferentiable , and convex in 
[z*,z*] ; 

2) F[z*] >y 0>^ F[z*] ; 

3) there is a linear operator P xZ'+W which has a 
continuous positive inverse; and -F'Lzl + r" holds for all 
z € [z»,z£l . 

Then, F has- a Newton sequence at z* which is monotone 
increasing and converges to z* e [z*,z*] , where F[z*] =0. 

Proof . Let z^= z* and V[z] = z + P * (F [z^] +F ' [z^] z) . 
Then V:Z~>Z, V is continuous, and 


V[0] = r F[z*] >/ 0, since P is positive, 

V[z* - Zq] = z* - Zq + P *(F[Zq]+F‘ [Zq] (z* - Zq)) 

z* - z„ + P 'f[z* 1 , by convexity, 

10 1 

^ z* -> Zq since F[z*] ^ 0 and P is positive. 
Furthermore, if hz 0 then 

V[z +-i2>z] = V[z] + AZ + r *F' [z^]^z >,V[z] , 
since P'‘p' [z^]4z ^ -^az . By lemma 3, V has a fixed point 
z' € [0,z*-Zq] . Let z^= Zq+ z'. Then z^ z* and 

F’ [Zq] (Zj^~Zq) = -F[Zq] . By lemma 2, F[z^] >0, so we can 
replace z* by z^ and use induction to show that |^z^^ exists. 
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and z^iz-4...4z 4z ...4-z*. 

0 1 n n+1 1 

lim z = z* exists, and z* e [z*,z*l . 
n->«c n 0 1 


Since Z is regular. 
Finally, 


0^F[z ] = -F'[z ](z ^-z )^=r (z ,-z ) 

n n n+1 n ' n+1 n 


But Z is normal, and z z 0, 

n+1 n 


soO'i-r’F[z]i^z --Z 
n n+1 n 

hence r~F[z^]'+0. By continuity, F[z*] = ol 

Before discussing the hypotheses and implications of 
this theorem, we will consider a simple application. The 

r‘ 2 

equation u(x) = T(x,y) [a sin u (y) - f (y) ] dy arises in 
the study of the forced oscillations of finite amplitude of 
a pendulum [27] . The function T is given by 


T(x,y) = 


r x(l-y) , 0 4 X i y 


y(l-x) , y < X ^ 1 


and we assume that f is a continuous function, with Oi^f^M. 
The spaces we use here are Z = W = L^[0,1] , with the usual 
ordering and topology. Let 

F[u] (x) = -u (x) + i T (x,y) [a^sin u (y) - f(y)]dy. 


Then 2 r‘ 

P'[u]h(x) = -h(x) +a T(x,y)cos [u(y) ]h(y)dy. 

Thus, F is G-differentiable and, for -l^^xtO, sin(x) is 

convex, so F is convex in the interval [-^,0]. Assimie, 

2 

furthermore , that a + M i tTT, in which case 
F\r%\ =X^ + J['T(x,y) [-a^- f (y) ] dy 

^3^ - (a^+ M) T (x,y) dy^ 3^ - ^ (a^+ M) ^ 0, 

F[0] = -rT(x,y)f (y)dy^ 0. 

O 

Finally, if h > 0 and uG [-’^,0] , then -F'[u3h^h, hence 
we can let P = I, the identity operator. All the conditions 
of the theorem are satisfied, so there must exist a Newton 
sequence, starting at u^ (x) = ^ which converges, mono- 

tonically, to a solution u* (x) which satisfies -]^iu*5;0. 

Referring to the table in chapter I, we see that the 
space Z in this theorem can be E^, H, or L^[0,1] , 0 ^ p <- oo . 
That the theorem does not hold in C [0,1] or l‘*’[ 0,1] , is 
shown by the following example. Let F:D c c^[0,l] W, where 
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D = {xr0^x(t)^l} W = [y : (l-t)^y(t) e L^[0,1] ] , 

F[x] (t) = (1 ~ x(t))^~^ . If the topology in W is given by 

(■* 2 

the norm uyii = uy(t)j (1-t) dt, then F is continuous, 

■^0 

twice G-differentiable , and 

P' [x]h = - x(t))‘'^^h(t) 

F' ' [x]hh - x(t))* h^ (t) 

Hence, P* ' [xJhh^O for all h, so by a result in chapter I, 

F is convex. Moreover, -F' [x]4 , and the operator 

P [y] (t) = y(t) has a positive continuous inverse. 

Finally, F[0] 0^F[1], so P satisfies the conditions of 

the theorem,, in the interval [0,1]. But, the Newton 

sequence for F at 0 is x (t) = 1 - t^, which does not 
^ n 

converge in C [0,1] . The same example can be used in the 
space l"‘[0,1] . 

Prom the proof of the theorem, we see that one method 

for solving the sequence of linear equations is to apply 

successive approximation to the operator V. That is, if 

z has been found , then let 
n 

V [z] = z + P''(F [z ] + F' [z ] z) , 
n n n 

and compute the sequence x = V [x ^], where x = 0. Then, 
from the proof of the theorem, 0 x. i x_ ^ . . . .^ z*- z , 

JL A 1 

lim X, = X* exists, and z ,= z + x*. 
k n+1 n 

The proof also shows that hypothesis 3) can be replaced 
by the slightly weaker hypothesis 

3') -P 'f' [z] 4 I, for z e [z*,z*] , where I is the 

identity operator, and P''is a positive continuous 
linear operator. 

This is weaker than 3) because we have assumed I ^0, but 
not P^- 0. In the case of a real function of a real 
variable, condition 3) means that the derivative is bounded 
in the interval. 

Because of the monotonicity of the Newton sequence, the 
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same proof holds if convexity is replaced by F' ' [z] ^0 
for z G [z*,z*] , provided W is normal and F is twice uniform- 
ly differentiable, so that lemma 2 is applicable. In this 

case, we also have -P' [z] 4 ~F ' [z*] for all z e [z*,z*] , hence 

0 0 1 

the result 

Corollary . Let F :D c Z W where Z is a regular PTL 
space, W is a normal PTL space, P is twice uniformly differ- 
entiable on every segment in an interval [z*,z*]^D^, and 

1) F* ' [z] ^ 0 for all z in the interval; 

2) P[z*] ^ 0 >P[z*l 7 

3) -F' [z*l has a continuous positive inverse.. 

Then, F has a Newton sequence at z* which converges, mono- 
tonicaily, to a solution z* G [z*,z*] of P[z] = 0. 

An example of a problem which can be solved using this 
corollary, but cannot be handled by theorem 1, is the 
Chandrasekhar H-equation, which arises in radiative transfer 
[ 1 , 8 ]; ^ 

H(x) = 1 + xH(x) J 

where f (t) is a given function. If we assume that f (t) ^ 0, 
and let 

P[z] (x) = 1 + xz(x)J ^ 

c 

then 

F' [z]h(x) = xh(x) xz(x) [ - h(x) . 

U X i‘ t X f-’t 

c* o 

Convexity of F would require that xh (x)j ^ 0 , 

for all h such that z and z+h lie in some interval. This 
is not true, but we do have 

P''[z]hk(x) = xh (x)J + xk(x)^ c:|t 

and hence F''[z]'^0 for all z. Finally, F[0] =1^0, 

-F' [0]h = h and, if 0 f (t) , then F[2] t 0. Hence, the 

corollary shows that there is a solution to the equation in 
the interval [0,2] which can be found by applying Newton's 
method. The bound on f which guarantees that F[2]^: 0 can be 
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relaxed. For example, it is known [8] that if f (t) 
then the equation has a positive solution, and we can use 
this solution as the upper bound, instead of z (t) = 2. 

The following table shows the results of some numerical 
calulations ' f or this equation. The iteration was started 
at Zq (t) = 0, and the linear equations were solved by 
replacing the integral by a numerical quadrature formula, 
using 24 stobdivisions , and then solving the resulting 
linear system by Gaussian elimination. 


n 

z (.25) 
n 

z (.50) 
n 

Zn(.75) 

z (1*0) 
n 



fft) = 0.25 



1.0 

1.0 

1.0 

1.0 

2 

1.1271957 

1.1825743 

1.2175054 

1.2419763 

3 

1.1296431 

1.1877202 

1.2249139 

1.2512373 

4 

1.1296444 

1.1877242 

1.2249208 

1.2512471 

5 

1.1296445 

1.1877242 

1.2249208 

1.2512471 



f(t) = 0.50 


1 

1.0 

1.0 

i.o 

1.0 

2 

1.3532370 

1.5429468 

1.6749577 

1.7736915 

3 

1.4616778 

1.7905519 

2.0628780 

2.2945761 

4 

1.5051736 

1.9031322 

2.2626224 

2.5933702 

9 

1.5426216 

2.0006399 

2.4412844 

2.8730492 

10 

1,5426290 

2.0006590 

. 2.4413195 

2.8731045 

11 

1.5426288 

2.0006585 

2.4413185 

2.8731029 



fft) = 0.25t 


1 

1.0 

1.0 

1.0 

1.0 

2 

1.0413517 

1.0637265 

1.0783764 

1.0888112 

3 

1.0414704 

1.0640055 

1.0787985 

1.0893541 

4 

1.0414704 

1.0640055 

1.0787985 

1.0893541 

Table 2 . Newton 

Sequence for 

Chandrasekhar 

Equation. 
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The above corollary is similar to the following result 
of Baluev [3] . 

Theorem (Baluev) . Let F:DCZ->W where Z is a normal, 

. 0 

regular PTL space, W is a normal PTL space, and D contaxns 
an interval such that 

1) F[Xq] 0 F[Yq] 7 

2) F is continuous and twice uniformly differentiable 


on every segment in [ 2 c^,yQ] ; 

3) the operator -F' [x] has a positive inverse for 

every x e ' 

4) F' ’ tx] ^ 0 for all x e [^CQ/y^] ? 

5) (F'[Xq 1) ' is continuous. 

Then, the equation F [x] = 0 has a unique solution x* in 

[x ,v 1 . The elements x and y , determined by the formulae 
0 0 n n 

X = X - (F’ [x ] ) F[x ] , 
n n-1 n-1 , n-1 


y = y - (F' [x J) J 

•^n n-1 n-1 n-1 


satisfy x ,^■x^^x*^y^^y ,F[x]^0 ?'F[y ] , and 

n-1 n n n-1 n n 

lim X = lim y = x*. 
n n 

(The statement of this theorem has been altered 

slightly to allow a direct comparison with the corollary. 

Baluev ' s proof remains unchanged . ) 

The important difference between these two results 

is Baluev's assiomption that F' [x] has an inverse. To 

illustrate the implications of this, consider the operator 

F:E^-»E^ defined by F(x,y) = (f (x,y) ,g (x,y) ) where 

... .4 


. f (1+x) , X < -1 

,x>.-l 


and g(x,y) = y^ . Then for (-2,-1) ^ (x,y) < (0,0), F" (x,y) 0 

and F(-2,-l) 0 F (0,0) . We use here the usual ordering 
in E^, given by the cone as defined in chapter 1. Further- 
more, F' (x,y) is defined by the matrix 


/h(x) 0 \ 

\ 0 2y y 



where 
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Hence , 


h(x) 


4 (1+x) ^ , X -1 

0 , X ^ “1. 


-F' (-2,-1) 



which has a positive inverse, and so the hypotheses of the 
corollary are satisfied. But, if x^-1, then F' (x,y) is 
singular, so Baluev's theorem cannot be applied. 

The above example also shows that the hypotheses of 

theorem 1 are not sufficient to insure that F' [z 1 has an 

n 

inverse . 

The rate of convergence for the Newton sequence in 
theorem 1, and its corollary, is similar to the convergence 
rate for the real case. That is, convergence is super- 
linear if F is continuously G-differentiable, and is quad- 
ratic if F is twice uniformly differentiable. More precisely, 
we have 

Theorem 2 . Let F:D<^Z“>W where Z and W are PNL spaces, 

F is continuously G-differentiable and convex in some 
interval [z*,z*]c:d^. Suppose F has a monotone increasing 
Newton sequence { ^ [Zq#z*] which converges to z* 

where F[z*] = 0. Furthermore, suppose -F'[z^]^l7 where 
f] ;Z->W is a linear operator with a positive continuous 
inverse. Then 


II z*- ^ ij 17 '||r(z*- z^) l|z*-z 


n+1 

where lim r (z*-z ) = 0. 

n 


n 


Proof . /7 iz*- ^ -P' (z*- 2^^^) 


= -F' [z ] (z*- z ) - F‘ [z ] (z - z ) 
n n n n n+i 

= -F' [z ] (z*- z ) - Fiz ] . 
n n n 


But, by convexity. 


~F'[z*] (z*- z^) ^ ~ 


so 


[7 (z*- z ^ -F' [z ] (z*- z ) + F' [z*] (z*- z ) 
' ' n+1 n n n 
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Therefore , 

0 ^ (z*- z P *(-F’ [z ] + F' [z*] ) (z*- z ) , 

n+± ' n n 

and 


11 z*- ^ il P"‘lM) F' [z^] - F'[z*]ll‘ !| z*- z^n 


n 


n 


Letting r(z^~ z*) 


|| F' [z^] “ F' [z*])l gives the result. 


Theorem 3. In addition to the hypotheses of theorem 
2, assume that F is twice uniformly differentiable on every 
segment in D^, and 1| F’ ' [z] || i- M for all z t [z*,z*] . Then 
Il Z*“ z 


n+1 


i. M il r7~'iM| z*- z^ir 


Proof. In the previous proof, we have shown that 
0 ^ z*- z , ^ 4 n"'(~F' [z ] (z*- z ) + F' [z*] (z*- z ) ) 


n+1 


n 


But, by the integral theorem of chapter I, 

-F' [z 1 (z*- z ) + F' [z*] (z*- z ) = 
n n . n 


= I 


[z*- t(z*-z )] (z*- z ) (z*-z )dt. 

n n n 


So we have, 

II z*- z^^^lU j|p“'l| |'l|F"[z*- t{z*- zjlll dt }|z*- z^ll 

il p-'j/ - jiz*- z^lp. 

These two theorems also hold if convexity is replaced 

by F‘ ' [z] ^0. In this case, we can set PJ = -F' [z*] , 

provided this operator has a positive continuous inverse. 

The problem of finding the endpoints z*, z* of the 

interval can be difficult at times. If the equation is 

known to have a solution, then this solution may often 

be used for z*. For example, the equation of Bratu [8] ? 

y(x) = n fT(x,t) e^^^^dt, 

“b 

where 

m i ^ (1“X) , 0i^t<xiil 

^ ^ [x(l-t) , Oi xi ti 1 


is known to have two continuous positive solutions, if 
O^TI^TIq, where Tl^ is a positive constant, approximately 
equal to 3.497. If we let 

F[y] = rijT(x,t) e^^^^dt - y(x). 
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and Z = W = L [0,1] , then for any hounded y, P is continuous, 
G-differentiahle, convex, and 

I m v>-). 


n T(x,t)e" 


h (t) dt 


-F' [y]h(x) = h(x) 

1 h(x) 

for all 0, hence we can let P [h] = h. Furthermore, 

F[0] = T] r T(x,t)dt = Tl>^jx(l-x) 0 , so we can set z*= 0 
'4 0 

and z*= z*, where z* is either of the solutions. 

It was observed earlier that -theorem 1 does not 

-1 


guarantee the existence of F'[z ] 

n 


However, by strength- 


ening the hypotheses slightly, we can prove that F' [z^] 
is invertible, and hence the Newton sequence can be written 
in the more usual form 

z ,.== z - F' [z ] ^F[z ] . 
n+1 n n n 

This is the content of the next theorem. 

Theorem 4 . Let where Z is regular and 

nomal, and W is solid. Let [z*,z*]ciD^ be an interval 
such that 

1) F is continuous, G-differentiable , and convex 
in [z*,z*] ; 

2) F[z*] ^ 0>.F[z*] ; 

3) -F' [z] ^ r , for all z t [z*,z*] , where P is a 
linear operator with a continuous positive inverse; 

4) either 


i) Z = W 


E 


n 


or 

ii) F' [z] is one-to-one, for all z e [z*,z*] ; 

5) either 

i) F[z*]«0 ( i.e., -F[z*] is an interior point 

of the positive cone.) 

or 

ii) -F'[z]^^^ where is a linear operator 

with a continuous positive inverse. 
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Then, P has a Newton sequence z^j at z* which is monotone 
increasing and converges to a solution of P[z] =0. More- 
over, -F' [z ] ^ exists and is positive, 
n 

Proof . Conditions 1),2),3) ensure the existence of 

the Newton sequence. We will use condition 5) to show 

that F' [z^] maps Z onto W and then, -by 4) , F' [z^] ^ is 

defined. Since W is solid, it is also reproducing. Hence 

it suffices to show that -F* [z ] maps Z onto the positive 

n 

cone of W. Let w^^ 0, and let 

V[z] = z +r '(w_+ F* [z ]z). 

U n 

If 5i)- holds, let z'= a (z*- z ) where a > 0 is such that 

In 

- aF[z*]^ Wq. If 5ii) holds, let z'= In the first 

case, we have 


F' [z ]z'= ap' [z ] (z*- z ) 
n n 1 n 

^ aF[z*] - aF[z ] 
1 n 


aF[z*]-t -Wq 


and in the second case. 


.-I 


F’ [z ] z '= F’ [z ]/\ w 
n n 0 


(Aj, w ) = -w 

0 0 


hence, in either case, z'^ 0 and P' [z ]z' + w^t 0. Now, 

n 0 

V is continuous , and 

1) V[0] =r*'w^^0, 

2) V[z’] = z’+r*(w+ F' [z ]z’)4 z'. 

On 

3) if A z ^ 0 then V [z+az] = V [z] + Az + P 'f ' [z^]az ^ V[z] . 

Thus, by lemma 3, V has a fixed point, V[z*] = z*, and 

0 4: z* z ' . But then -F' [z ]z* = w_. Hence, -F’ [z ] maps 

n 0 n 

Z onto the positive cone of W, and this , together with 

condition 4) implies that -F' [z ] ^ exists and is positive. 

n 

In practice, it is often very difficult to find even 
an approximate solution to the set of linear equations 
which determines the Newton sequence. This fact leads to 
two interesting questions; will a sequence of approximate 
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solutions converge to a solution of the nonlinear problem, 

and, is it possible to replace the set of linear equations 

by another set which can be solved more easily and such 

that the solutions to these new equations still converge 

to a solution of the nonlinear problem? One simple answer 

to the first question is given by the observation that, if 

^ is a monotone Newton sequence for P which converges 

to z*, where F[z*] = 0, and is approximate sequence 

which satisfies z < z' z*, then O ^r z*- z' , z*- z , 

n n+1 n+1 n 

so, by the normality of Z, lim z' = z*. This means that if 

n 

we solve the linear equations by successive approximations, 

as suggested earlier, it is only necessary to carry out a 

few steps of this process, since any of the successive 

approximations will give a z' . which satisfies the above 

n+1 

inequality. 

To answer the second question, we consider equations 

of the form FT (z ^ - z ) = -p[z ], and look for conditions 
^ n+1 n n 

on the operators which will guarantee the existence and 
convergence of the sequence { to a solution of F[z]=0. 
Theorems of this kind have been proven by Slugin [24,25] 
and Baluev [2,3] . Their theorems are concerned with two- 
sided approximations. However, using the same type of proof, 
the following result is easily proven. 

Theorem (Slugin) . Let F:Dcz-+w, where Z is a normal 
regular PTL space, W is a normal PTL space, and [z*,z*]«^D^ 
is an interval such that 

1) F is continuous, G-dif ferentiable , and convex in 
the interval; 

2) P[z*] >. 0 F[z*] ; 

3) for every z in the interval there exists a linear 
invertible operator Q such that * is positive and 

-F- [z]^ 4 r 



48 


where P is also linear with a positive continuous inverse? 

Then, there is a sequence ^ z \ CZ [z*,z*] which is defined 

(. n J u 1 

by 

^0= ^0' V 

and satisfies ^...iz <-z ...iz*. Moreover, 

01 n n+1 1 

lira z = z* exists and F[z*3 = 0. 
n 

Using the methods of Slugin and Baluev, the hypothesis 
that r^~' exists is certainly needed. However, with the ideas 
of theorem 1, we can remove this condition. The resulting 
theorem is ; 

Theorem 5 . Let F:D c; z -^W where Z is a regular normal 
PTL space, W is a PTL space, and [z*,z*]ciD® is an interval 
such that 


1) F is continuous, G-differentiable, and convex in 
the interval; 

2) F[z*] >. 0 ^-F[z*] ; 

3) for every z in the interval, there exists a Q which 
is continuous, linear, and satisfies 


-F- [z]^ q - P 


where P is a linear operator which has a continuous positive 
inverse . 

Then, there is a sequence ^ [z*,z*] which satisfies 


and z*~ 

0 u 

F[z*] = 0. 


■‘n ' n+1 
4 z, -i: . . . 4 z Z 


= F[z_] 


n 


n 


n 


. . . 4 z* , lira z = z* where 
n+l" 1 n 


Proof . The proof is identical to that of theorem 1, 

with -F' [z^3 replaced by . 

An illustration of this result is the Liebmann iteration 
as described by Greenspan and Barter [10] . When the mildly 
nonlinear elliptic partial differential equation 

Au = g (u,x,y) 

is discretized, in the usual way, the resulting system of 
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equations has the form AX = f (X) , where X = (x, ) 

12 n 

and A is an n by n matrix with a positive inverse and non- 
positive off- diagonal elements. If g(u,x,y) is convex as 

a function of u, then f (x) = (f , (x, f (x ) ) where 

11 n n 

f ^ (x) is convex. Newton's method applied to this system of 
equations gives 

Ax(k+1)_ D(X^^^ )X^^’’'^^= D(X^^^)X^^V f(X^^^) 


where D (X) is a diagonal matrix with elements f!(x.) . Thus, 

(k+1) ^ ^ (k) 

finding x' requires the inverting of the matrix A-D (X ) . 

The process can be simplified considerably if we assume 

-fj^(x)<m, and write A = D - L - U, where D is a diagonal 

matrix, L is lower triangular, and U is upper triangular. 

If F(X) = f (X) - AX, then 

-F ' (X) = A - f • (X) ^ A + ml 


= D + ml - L - U 


6 D + ml - L 

since U^O. Thus, letting fjj =P= D + ml - L, theorem 5 
gives the sequence of equations 

(D + ml - L)X = UX + f (X ) + mX 


which is easily solvable since the matrix on the left is 
lower triangular. Theorem 5 says that if F(X^^^)-^ 0-J^F(X^^^) 
then the sequence [ is monotone increasing and 

converges to a solution of AX = f (X) . 


Mildly Nonlinear Equations 

Because the spaces C^[0,1] are not regular, we cannot 
use theorem 1 directly to solve nonlinear differential 
equations. However, if the equation is a boundary value 
problem, of the form L[u] = f (u) , with appropriate boundary 
conditions, where L is a linear differential operator which 
has a positive Green's function, then the differential 
equation can be replaced by the equivalent integral equation 
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u(x) = r G(x,t)f (u(t))dt. 

We can now investigate this equation in the regular space 
2 

L [D] . This method can be applied, for example, to the 
problem 

u' ■ (x) = , X e [0,1] 

u(0) = u(l) = 0. 

which is equivalent to the equation of Bratu 

u (x) = r T(x,t)e^^^^dt 
■i. 

which we solved in the proceeding section. Consider, 
however, the equation 

u' ■ (x) = , X 6 [0,1] 

u(0) = u(l) = 0. 

Proceeding as before, we have the equivalent equation 

u(x) = f T(x,t)e ^^^^dt. 

We let Z = W = [0,1] , D = u : u(0) = u (1) = 0 j , and 

F[u] (x) = r T(x,t)e ^^^^dt - u(x) . 

6 

But then i 

-F’[u]h(x) = h(x) + J T(x,t)e ’^^^^h(t)dt, 

O 

and if u(t) ^ 0, then ^ 

-F' [u]h (x) i h (x) + r T(x,t)h(t)dt. 

I 

Letting P [h] = h (x) + J[ T (x, t)h (t) dt, then P has an 
inverse given by ^ 

P"’[k] (x) = k(x) - J R(x,y)k(t)dt 
where R(x,t) is the resolvent kernel for T. But T is 
positive, so R is also positive, and hence V is not 
positive. Returning to the differential equation, and 
ignoring for a moment the problems of convergence, let 

F[u] = e + u' ' . 


Then formally, we have 
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-F' [u]h = -h” + -h' • + ah, 

for all u such that a. But, it is known [5] that 

the operator G[h] = -(h’'~ ah) has a positive Green's 

function provided a^O. Furthermore, F is convex and 

F[0] = 1 0 ^ F [>i X (1-x) ] . Thus, it appears that this 

operator satisfies all the conditions of theorem 1, except 
, . 2 

that the domain space, C [0,1] , is not regular, and F is 
not continuous. Note that F‘ [u] as defined above is not a 
continuous operator, hence is not a G-derivative. In the 
remainder of this chapter, we will study operators which 
can be written in the form F = f - L, where L is linear, 
but not continuous, and f is G~differentiable . Then F' [u] 
will denote the (dis -continuous) linear operator f ' (u) - L, 
where f ' (u) is the G-derivative of f at u. 

In the next theorem, we prove a result similar to 
theorem 1, in which the space Z does not have to be regular. 

Theorem 6 . Let F:D«^Z->W where Z is normal, W is 
regular and normal, and F = f - L where f and L are operators 
which satisfy the following conditions. 

1) L is linear and has a completely continuous positive 
inverse on W; 

2) f is continuous, G-differentiable, and convex in 
some interval [z*,z*]c:d*^ 

3) L[z*]^ f (z*) 

L[z*] » f (z*) ; 

4) there is a continuous linear operator g:Z->W such 

that, for every z in the interval, f (z) ^ g, and moreover, 
the operator P = L - g has a positive continuous inverse. 
Then, F has a Newton sequence at z* which is monotone 

increasing and converges to a solution of L[z] = f (z) . 

Proof . Even though F = f - L is not G-differentiable, 
if we let F' [u]h = f ' (u)h - L[h] , then 
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P' [u]h^ f (u+h) - f(u) - L[u+h] + L[u] = P[u+h] - F [u] , hence 
P formally satisfies the convexity condition. Now, let 

V[w] = w + F[Zq] + F' [Zq] r”'w 
where z^= z*. Then V:W“>W, continuously, and 
V[0] = F[z^] ^ 0, (by 3) , 

V[P (z*- Zq)]= r (2*- 2 q) + P[Zq] + F' [Zq] (zJ- Zq) 

4 r (z*- Zq) + F[z*] 

fc r (Z*- Zq) , 

and r (z*- Zq) ^ -P' [Zq] (z*- Zq)>^F[Zq] -F[z*]>^ 0. 
Finally, if ^w^O, then 

V[w+Aw] = V[w] + Aw + F' [Zq] r‘'Aw ^ V[w] , 


since, by 4) , 


F' [Zq]P'aw^ - P r Aw. 


Thus, V satisfies the conditions of lemma 3, except it is 
not continuous.. Nevertheless, we still have a sequence 

«0= “■ ”n+r '"''n'- 

which satisfies 0 = ^0' ... 4 '^n+l^ • • • ^0^ ’ 

Hence, by regularity, w* = lim w^ exists, and 


0 4 w*4 r (z*- Zq) 


To show that w* = V[w*] , note that 

V[w] = w + F[Zq] + f ' (zQ)r"'w - Lr'w 


so, 

+ L-^f (2o)r'\ - r\. 

Now, taking limits, as n-^'» , we have 

l"^w* = l“^w* + l"^F[Zq] + L"^f ’ (zQ)r"w*-r-'w*, 

hence, w* = V[w*] . But, if we set z^= Zq+i w*, then 

z < z, .4 z* and F’ [z^] (z.- z^) = -F[z ] . By the proof of 
O il 010 u 
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lemma 1, we have F[z^] 0, and so proceeding by induction, 

we get a monotone increasing bounded sequence | z ^ . But 

this sequence satisfies 

L[z ] = f ' (z ) (z - z ) + f (z ) 
n+1 n n+1 n n 


or, equivalently, 

^n+1 


z ., = ' (z^) (z . - z) + f(z )] 


n' ' n+1 n' 


n 


Let 


w = f (z ) (z z ) + f (z ) 
n n n+1 n n 


Then, w_^g(z^^^- z^) + f(z^) and, by convexity, w_-$ f . 


n' ■ n+1 n 
But, also by convexity. 


n 


n 


so 


and 


so 


Hence 


or 


f {z*- f (z|) - 


£(Zn_^l) .< £(z*) - f ■ (z|- 

' ^n+l> 


f'{z*)(Zn“ z*) ^ f(z^) -* f(z*) 


f(z f (z*) (z -z*) + f (z*) 
n 0 n 0 0 

>y g (z^- zj) + f (z*) . 


9<Vl‘ ^0> + '*n« ■ 9(zj- 


-g(z*) + f(z*)^ w^- ^^^n+l^"^ ^^^1^ - ^^^1^* 

Thus, the set f w - g (z , )) is order bounded. But W is 
t- n n+1 ^ 

normal, so this set is, in fact , bounded. Now, is 

order bounded, hence bounded, and g is linear and continuous, 
so |g(z^)j is bounded. Therefore, { i® bounded. 




Since 
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L is ccanpletely continuous/ so ^ ^ { '^n} 

totally bounded. Thus, there is a convergent subsequence 

{ z„ I / with lim z. = z*. But since this sequence is mono- 

tone, and Z is normal, z* = lim z . Finally," F[z*] = 0, 

tv+» n 

because 


g (z - z ) -^ f (z ) (z - z ) -^ f (z ) - f (z ) 
n+1 n n n+1 n n+1 n 

so clearly, IJm [f ' (z^) 2 ^)] = 0. Applying this 

to the formula 

n+1 n n+1 n n 

-1 

gives z* = L [f(z*)] , or 

L[z*] = f (z*) , 


Comparing this theorem to theorem 1, the only assump- 
tion that has been added, aside from the special fomn of 
the equation, is the condition that the operator -F' [z] 

can be written as P = L - g, where g4 f (z) . 

We have already observed that the equation u" = -e 

with boundary conditions u(0) = u(l) = 0, satisfies the 

2 2 

hypotheses of this theorem, with Z = C [0,1], W= L [0,1], 

D = {z : z(0) = z‘(l) = 0 } , L[u] = -u", f (u) = e z* = 0, 

—A ^ 

z* =]^x(l-x) and g (h) = -e ^ h, where ^8 = max z* (x) . Since 

we know that the operator H[h] - -(h" - oth) has a positive 

continuous inverse, provided a^O, clearly the operator 

L - g has a positive continuous inverse. 

As another application, consider the Ricatti equation 

u'(x) = u^+ a(x)u + b(x) , u(0) = c. 

1 2 

The spaces we use here are Z = C [0,1], W = L [0,1] , 

D = {u ; u(0) = cj , with the usual topology and order- 

2 

ing. Letting L[u] = u', f (u) = u + a(x)u + b (x) , we have 
L ^ is positive and completely continuous. If b (x) ^ 0 
then L[0] = O-^f(O) = b (x) , and if u* is a positive solution, 
then in the interval [0,u*] we have 

f ' (u) h = 2uh + a (x) h ^ a (x) h - g (x) 
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and (L - g)h = h' - a(x)h has the inverse 

% 

(L - g)“\(x) = f e i^^^^‘^\(s)ds. 

-1 

Hence P* = (L - g) is continuous and positive, provided 
a{x) is integrable on [0,1]. Summarizing this, we have 

Corollary . If b (x) ^0, a (x) is integrable, and the 
equation 

2 

u' (x) = u + a (x)u + b (x) , u (0) = c 
has a positive solution, then this equation has a monotone 
Newton sequence which converges to a positive solution. 

Kalaba [11] has computed a Newton sequence for this 
equation in the special case a (x) = 0, b (x) = 1, and his 
results clearly show the monotone character of the sequence. 

As with many of our previous theorems, the hypothesis 
that f is convex can be replaced by f 0, provided f is 
twice uniformly differentiable. The resulting theorem 
is 

Theorem 7 . Let FiD c z W where Z is normal, W is 
regular and normal, F = f - L, and [z*,z*]«=^D where 

1) L is linear and has a completely continuous 
pos itive inverse ; 

2) f is continuous, twice uniformly differentiable 

and f ' ' (z) 0 for all z in the interval; 

3) F[z*] 0 ^ ; 

4) L - f (zj)^ L - g where (L - g)”^ is positive and 
continuous . 

Then, the conclusions of theorem 6 hold. 

An interesting application of this theorem is the 
following integro-differential equation of Volterra[8] ; 

y' (t) = ay(t) + by^ (t) + y (t) ^ K(t,s)y (s)ds , 
where a^O, b>x0, K^O, and y (0) = Yq> = Y ' 

2 

f (y) = ay + by + yj K(t,s)y (s) ds . 


and 
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Then 


t t 

f ' (y)h = ah + 2byh + y f K(t,s)h (s) ds‘ + h J'K(t^s)y(s)ds 


and 

f ' ' (y)hk = 2bkh + kj K(t,s)h(s)ds + h ( K(t ,s)k (s) ds . 

o 

Hence f ’ (y) ^ 0 for all y. Using the spaces Z = C [0,1] , 

W - L [0,1] , D = { z : z(0) = y^i } / we have L h”J h(t)dt, 
X U o 

so L is positive and completely continuous, and if 

(t) = y^ then L - f ' (z*) ^ (L - a) and 


(L - a) 


f 


^a(x ^ 


Finally, it is known that the equation has a positive 
solution y*, and if K(t,s)^ 0 then y*^ z*, hence we can use 
the interval [z*,y*j . 

To estimate the rate of convergence, we can use 
theorems 2 and 3, however, because of the special form of 
these equations, a slightly better result can be proven. 

Theorem 8 . Let F:Dc:z-^W where Z and W are PNL spaces, 

F = f - L where L has a continuous inverse, f is continuous, 

convex, and continuously G-differentiable. If F has a 

Newton sequence ^ z^ j which is monotone increasing and 

converges to a solution z* of F[z] = 0, and if 

- 1 * 


II L IMlfCz jlKi 


n 


then 


ll-n+r 


iiL-hi 


1-I|L-'|I ||f ' (zjll 


r (z - z*) • l!z - z*l! 
n ‘ n 


where r'(z - z*)~^0 as z z* , 
n n 

If f is twice uniformly differentiable, and 


then 


m = max[ II f ’ (z ))| , Ilf ' ' (z ) || ] < 1 , 

n n 

llz - z*||4 II z - 

l-ljL-'llm ^ 


Proof. 


-F' [z^] (z*- z^^^) = -P' [z^] (Z*. zj + P' [zj z^) , 
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hence, 

-F' [z ] (z*- z ^ = -F' Iz ] (z*~ z ) - F[z ] 

n n+1 n n n 

£ -F' [z 1 (z*- z ) + F' [z*] (z* - z ) 
n n n 

since 

-F' [z*] (z*- z ) ^ F[z ] - F[z*] = Ftz I . 

n n n 

But 

-F’ [Z^l (2*- 2^^^) = L(2*- - f ■ (2j (2*- 2^^^) 

SO 

L(z*- z ) ^ f ’ (z ) (z*“ z ) + f ’ (z ) (z - z*) - f ' (z*) (z ~ z*) 
n+1 n n+1 n n n 

and hence 

0^ z*-> z ^ L’'^[f ' (z ) (z*-z )+[f ' (z )-f ' (z*)] (z - z*)] . 

n+1 n n+1 n n 

Since the norm is monotone, this gives 

II z*- z^^^||^|jL“^j|.|^llf ‘ (z^))| • llz*-z^^^l| + 11 f (zj-f • (z*)il llz^-z*|lj 

Setting ^ (z^- z*) = Ij f (z^) - f (z*)l| , the first estimate 

follows easily. If f ' ’ is continuous, then by the integral 

theorem of chapter I, 

f (z*) (z - z*) - f (z ) (z - z*) = 
n n n 

ff * ' (z +t(z -z*) ) (z - z*) (z - z*)dt, 
n n n n 

so I 

I) f ' (z*) - f ‘ (z )|) < fjlf • (z +t(z -z*))|| l(z - z*||dt 

XI ^ XX Xx XX 

^ m l!z^“ z*li 

and the last estimate follows easily . 

Most of the results of Kalaba [11] are included in 
the above theorems. (When applied to differential equations, 
Newton's method is often called "quasi-linearization.") 

Kalaba has shown that this method can be an effective 
technique for solving certain types of ordinary and partial 
differential equations. (See also [5] .) It should be noted, 
however, that several types of equations, which Kalaba 
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considers, cannot be solved using this technique, except in 
very special circimstances . For example, suppose a Newton 
sequence for the Dirichlet problem 

u = f (u,x,y) , (x,y) fe D 

u(x,y) = 0 , (x,y) e 

is monotone and bounded. Then the sequence will converge 

2 . , , 
in L [0,1] . But, without further informatxon, it cannot 

be concluded that this limit function is a solution to the 

differential equation. In fact, the limit function for 

such a problem may not even be continuous. Another type of 

equation which presents a problem is 

u ' ' (x) = f (u,u' ,x) 

u(0) = u(b) = 0. 

The Newton equations for this problem are 


u';,= f (u„,u:)+|f (u„,u;) 


n+l 


n n 


n n 


n+l n 


n n 


n+l n 


Hence, even if it can be shown that the sequence | ] 

exists, is monotone and bounded, the presence of the 

derivatives u ' , and u ' in these equations prevents us 
n+l n 

from concluding that the sequence converges to a solution. 
In the context we. have been using, if we write the equation 
as 


L[u] = g (u) , 

where g (u) = f (u,u',x), then, in the topology given by the 

maximum norm, g is neither continuous nor differentiable. 

The remarks made in the previous section concerning 

the convergence of an approximate sequence apply also to 

these equations . The modification of theorem 6 which 

corresponds to theorem 5 is ; 

Theorem 9 . In addition to the hypotheses of theorem 6, 

for every z e [z*,z*] let g be a continuous linear operator 

0 1 z 
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which satisfies 


f (z) ^ g 

Zi 

If n = L - g then there exists a monotone increasing 
^ z 

sequence ^ z^] d Cz*,z*] which satisfies 

[T (z - z ) = 

*h n+1 n n 

and which converges to a solution of F[z] 0. 

Proof . In the proof of theorem 6, rep^uce -P* [z^] 

When solving, for example, the equation u' ' = -f (u) , 

the Newton sequence is given by the equations 

z'' = f ' (z ) (z - z ) + f (z ) . 

n+1 n n+1 n n 

If f is convex, then we can replace f ’ (z^) by the divided 

difference 




f (z ) - f (z , ) 
n n-1 

z - z 
n n-1 


and, by -convexity, f ' (z^) ^ Hence, if we set f^^h = h"-^^h 

then the Newton equations have the form 

z'' = i (z - z ) + f(z ). 

n+1 n n+1 n n 

If f (u) has a complicated derivative, it may be much 
easier to ccmpute then to find f'(z^), however, theorem 
9 still ensures the convergence of the sequence to a solution 
of the equation. 


Equations in Spaces with Partially Ordered Norm 
As a final application of the preceeding results , we 
will prove a convergence theorem for Newton's method applied 
to operators on spaces which are normed by a PTL space . The 
theorem is an extension of a theorem of Kantorovich ([14], 
see also [1]). In the following, if F:X*^Y and Q:Z-^W, 
where X and Y are noimed by Z and W, respectively, then we 
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write 1)F)|4Q if tlF[x]li< Qiz] for all x 6 X, ztZ, such that 
ilxii 4 z . 

The Kantorovich theorem is; 

Theorem . Let Z he a regular, solid PN space, W a 
solid PB space, and let X and Y be normed by Z and W 
respectively. Assume that X is complete in the Z-norm 
topology. Let F:DCX-^Y satisfy the following; 

la) F is twice continuously G-differentiable in a 
sphere S(xQ,r^) = {x : Ijx-x^lU r^] c D°. 

lb) = F' [Xq] maps X onto Y, and Pc"' is continuous. 

Assume there exists an operator Q:Z*^W which is twice 
continuously G-differentiable on [Zq,z*] where r^^ z*- z^, 
and 

2a) Zl<,= -Q'EZq] has a continuous inverse, and !t H 5; aJ 
2b) fEXqII! ^ A;!qIZq]; 

2c) If [7"' F"[xH! i Z\l Q"[z] for all x,z with 
llx-x^tU z-Zq^ z*- z^; 

3) the sequence { defined by ^ *-^n^ 

exists, remains in [z^,z*] , and converges to a solution 
z*e[zQ,z*] of Q[z] = 0. 

Then, there exists a sequence S (xQ,r^) , defined by 

X ^ = X - F' [x ] ^F[x ] 
n+1 n n n 

which converges to a solution x* of F[x] =0. Furthermore, 

U X - x*ll 4 z*- z . 
n n 

In stating the differentiability conditions on F and 
Q , we have used the fact that theorem 12 of chapter I also 
holds for these spaces . 

Condition 3), in most cases, is very difficult to 
verify. The theorem which follows modifies conditions 2b) , 
and 2c) slightly, and replace^ 3) by a much simpler hypothesis. 
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The eonclusion remains unchanged. Before doing this 
however, we need some preliminary results. In particular, 
we must prove a generalization of the well-known Banach 
theorem; 

If F;X~>X, where X is a Banach space, and 
)lPii ^ q < 1, then I - F has an inverse, with 

11(1 - Fr‘)l ^ (l-q)"' 

Lemma 4 . Let X be normed by a regular and normal PTL 

space Z, and assume the Z-norm topology is complete. If 

F:X-»X and Q;Z->Z are continuous linear operators with 

lIFllfeQ, and if I - Q has a positive inverse, then I - F 

has an inverse, and 1| (I - F) ^ (I - Q) 

Proof . Let x & X be arbitrary. For any z e Z with 

iixii^:z, we have IlF [x]l( t Q [z] , and by induction, also, 

II F^[x] II 4: Q^[z] . Let 

S X = X + F [x] + F [x] + . . .+ F [x] , 
n 

2 n 

T z = z + Q [z] + Q [z] +...+ Q [z] . 
n 

Then 0^Tz4T .z^(I-Q) ^z because 
n n+1 

(I - = z - Q^*''^[z]^r z, 

hence , 

T ,^z ^ (I - Q) ^z. 
n+1 

But Z is regular, so z* = lim T^z exists and z* (I - Q) '^z. 
Furthermore , 

Ot|jSx-Sx|l^Tz - T z 
n m n m 

and the sequence Tz-Tz-+0, so by normality, S x-S x -;>0. 

n m n m 

By completeness, x* = lim S x exists. In. fact, 

X* = (I - F) X 

because, 

II (I - F)S X - xll = 11 F^’^^xii i Q^'*’^[z] -> 0, 
n 

so lim (I - F)S X = X. Since F is continuous, this gives 
h-»<» n 
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(I - P)x* = X, and, if (I - F)x** = x, then letting x* = 
X** - X*, we have I) x'jj = HF[x'] H Q[ || x' || ] / hence 

(I - Q) [ !1 X' II 0 

so II X 'll 4 0. Thus x' = 0 and x** = x* . Therefore, 

(I - F) ^ is defined on all of X, and 

II S xlj 4 T z* 4 (I - Q)“^z 
so 

lim Ij S x|l 4 (I - Q) ^z, 
n-?oo n 

hence 

H (I - F)“^xl! (I - Q)"^z. 

The integral theorem of chapter I will be used in the 
following form; 

Lemma 5 . Let u: [0,1]-^ Y where Y is normed by a PB 
space W. If u is uniformly differentiable on [0,1] , then 

rHu' (t))| dt 

exists, and ^ 

II u(l) - u(0)ll 4 fliu' (t)ll dt. 

Proof . Using the proof of theorem 13, chapter I, we 
can show that (* u' (t)dt exists, and 

I 

u(l) - u{0) = fu'(t)dt. 

Furthermore, the function v (t) = Hu' (t)l| is continuous 
and maps [0,1] into W, where W is a Banach space. Hence 
V is integrable. That is, J Mu' (t) 11 dt exists, and thus 

1( u(l) - u(0)H = II fu' {t)dt II 

'^O 

4 Mu ' (t) 1) dt . 

”x> 

Finally, we note that if F:Z-»W is a positive linear 

operator from a solid PN space Z to a PN space W, then 

F is continuous because,' if z •-? z* then, by theorems 5 

n 

and 7 of chapter I, 

-Tlu4z-z*^Tlu 
‘n n n 

for some uJ>0, and Tl^-^O. Hence, 

-Tl F[u] 4 F[z ] - F[z*] 4 U F[u] 
n n n 
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so, by normality, P [z^] -> F [z*] . 

We can now state and prove the main result of this 
section. 

Theorem 10 . Let Z be a regular, solid PN space, W 
a solid PB space, and let X and Y be normed by Z and W, 
respectively. Assiome that X is complete in the Z-norm 
topology. Let PiDc-x-^Y satisfy the following conditions. 

la) P is twice continuously G-differentiable in a 

sphere S(xQ,rQ) = { x : li x - x^U i r^j c: D^; 

lb) = F‘[Xq] maps X onto Y, and fi”' is continuous. 


Assume there exists an operator Q: Z“^W which is twice 
continuously G-differentiable on [Zq,z*] where r^ ^ z*- z^, 
and 

2a) II i Ao' where -Q ' [ZqI ; 

2b) I)F[Xq]}| ^ Q[Zq] 7 

2c) !|F"[x]j| 4 Q"[z] for all x,z with 


2d) Q' [z] is one-to-one, for all z6 [z^,z*] ; 

2e) Q[z*]«0. 

Then, there exists Newton sequences » l^n^ where 


X ^ = X - F' [x ] ] 

n+1 n n n 


z„-Q‘[z^] "q[z ] 
n n n 


which converge to x*,z* respectively, where x* 6 S(xQ,r^) 

z*6 [Zq,z*3, P[x*3 = 0, Q[z*] = 0, and 

M X*- x)l 4 z*- z . 

n n 


Proof . Q is twice uniformly differentiable, Q” ^ 0 , 
-Q'[z] is inverse positive, -Q'[Zq] has a positive inverse 
which is therefore continuous, and Q Iz^] 0 »Q [z*] . Hence, 
by an obvious corollary to theorem 4, Q has a Newton 
sequence at z^ which converges monotonically to a solution 
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2 * e [Zq,z*] of Q[z] = 0. Furthermore, Q' [z^] has a positive 
(hence continuous) inverse. Now, 

3^1= Xq- Q F[X|^] 

exists, and 

^ IT'f[X|^]11 ^ A;'Q[Zq] = z^- z^i z*~ Zq. 

So x^6 S (Xq/Xq) . We will show that all of the hypotheses 
of the theorem are satisfied if x^ and z^ are replaced by 
x^ and z^. First we prove 

2b') It F[x^] !! 4 Q[z^ 

Let 

u(t) = F[x^+ t(x^- Xq) ] + (l-t)F' [x^+ t(x^~ Xq)] (x^- x^) . 

Then 

(t) = F' [X|,+ Xg)] (X^- Xg) + 

+ (l-t)F"[x^+ t(x^- Xq)] (x^- Xq) (x^- Xq) - 
- F’ [Xq+ t(x^“ Xq)] (x^- Xq) 

= (l-t)F"[XgH- t(x^- Xg)HXj^- Xp) (X^- Xq) . 

By lemma 5 , 

11 u(l) - u(0)ll (= [ l!u« (t)tl dt, 

’-'o 

so 

II F[x^3 - F[Xq] - F' [Xq] (x^- x^) 11 4 

4 f ll{l-t)F’'[xQ+ t(Xj^- Xq)] (x^- Xq) (x^- XQ)dtil. 
But F' [Xq] (x^- Xq) = 

i)F[x^]ll t J'(l-t) ||F’'[Xq+ t(x^- Xq)] (x^- Xq) (x^- Xq)11 dt 

4 ^‘(l-t)Q’’[zQ+ t(z^~ Zq)I (z^- Zq) (z^- z^)dt 
= Q[z^] - QEZq] - Q' [Zq] iz^- Zq) 

= Qlz^I. 

Next we show that F' [x^] has a continuous inverse, and 
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2a’) 11 r;~'l| 4 

Let u (t) = -F' [Xq+ t(x^- XQ)‘]h, where h e X is arbitrary. 

Then u:[0,l]-»Y, u is continuously differentiable, and 
lemma 5 holds. Hence, if lihlf 4 b, 

II (F'[Xq] - F’[x^])h!| 4 ]j1F"[Xq+ t{x^- XQ)]h(x^- x^)ll dt 

i |'Q”[V t(Z^- 
= Q' - Q’ [Zq]1c 


where A, = -Q'[z^]. Thus, by 2a) 

II i;"Crr - H’ )II ^ ( A,- /\) 

where fj* = F’ [x^l . Now, Q"[z] ^ 0, so Aj - Ao , and 
so aVAc.^O. Let G = r^~* ( 1 ^- 17 )/ P= A7' * Then 
G:X->X, PiZ-^Z, llGll P, and (I - P) A^'Z^^O. So by 
lemma 4, (I - G) ^ exists and is continuous. Also 

(2) ii (I - G)“^!1 4 (I - P)~^= A"' Ao 

But, 

(I - G)~^= (t;‘'r7)"^= rr' a 

so 17 ' exists and is continuous. We still have to show 

$ A7' 


or, equivalently, 

n r;"yii ^ a^'w 

for all y,w with . ii yn 6 w. Let y = 17 x. Then if Uyn ^ w, 
2a) implies 1| 7“' y 1) 4 A"7 w. That is ilxii4 a" 7 w. Thus, by 
(2) iil7"'f;xii4 A7 *a/a7’w) 

or I) 11 4 A"/ W 

By induction then, we have proven that | x^j exists and 


X ,,-x 11 4 z z , 

n+1 n‘ n+1 n 


II ’'n+p- =^nll ^ ^ 


n+p 


z . 
n 


therefore. 
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As n-j-cr. z - z 0, so j(x , - xli-^O. Since the 
n+p n " n+p n" 

topology in X is complete, x* = lim x^ exists. Finally, 

F[x*] = 0 because, 0 |( P[x ] |1 4^ Q[z ] and Qiz ]-^ 0 so 

n n n 

F[x ]-^ 0. Since F is continuous, 0 = lim F[x ] = F[x*] 
n n 

Note that in the important case where Z = W == E^, 

condition 2d) can be eliminated. In this case, the only 

major addition to the Kantorovich hypotheses is 2e) . 

However, implicit in condition 3) of the Kantorovich theorem 

is the existence of a point z* e [z^,z*] such that Q[z*]=0, 

and 2e) is only a strengthening of this. 
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